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TITLE OF THE INVENTION 
COLOR SEPARATION CIRCUIT OF 
SINGLE CHIP COLOR CAMERA 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to a color 
separation circuit of a single chip color video 
camera utilizing a solid-state image pick-up device. 
Description of the Prior Art 

(1) In a single chip color camera utilizing a 
solid-state image pick-up device such as a CCD 
(Charge Coupled Device) , there is provided a color 
filter in a particular color (e.g. , any one of three 
colors R, G, and B) corresponding to each of pixels 
composing the solid-state image pick-up device. A 
signal from each of the pixels composing the 
solid-state image pick-up device, which corresponds 
to the particular color, is processed to make color 
separation, thereby producing R, G, and B signal 
video signals. 

Conventionally, the color separation in the 
color camera represents processing for separating 



and producing a luminance signal and a chrominance 
signal from a CCD signal. Currently, it represents 
processing for producing RGB signals at the 
positions of all pixels from the CCD signal in many 
cases. For this reason, the color separation from 
the CCD signal is also referred to as chrominance 
signal interpolation and pixel interpolation in many 
cases . 

Fig. 13 illustrates conventional color 
separation processing. 

Consider a case where G and R filters are 
alternately arranged in the horizontal direction, 
for example, a G filter, an R filter, a G filter, 
an R filter, as shown in Fig. 13 (b) , for example. 

In such a case, a G signal is not obtained from a 
pixel at which the R filter is arranged, for example. 
Accordingly, a G signal corresponding to the pixel 
is found by interpolation using signals at the 
adjacent pixels. That is, the average of the signal 
from the first G pixel and the signal from the third 
G pixel shown in Fig. 13 (b) is calculated, thereby 
making it possible to obtain a G signal corresponding 
to the second R pixel. This method utilizes a 
correlation in the horizontal direction, as is well 
known . 
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In such a simple interpolation method, however, 
it is known that a false chrominance signal is 
generated at the boundary (an edge) where black and 
white portions are adjacent to each other on a 
screen. The generation of the false chrominance 
signal will be simply described. 

Light from an image which is rapidly changed 
from white to black, as shown in Fig. 13 (a) , shall 
be given to the solid-state image pick-up device in 
an arrangement of filters shown in Fig. 13 (b) . At 
this time, it is assumed that a signal output value 
from each of the pixels takes a value, as shown in 
Fig. 13 (c> . That is, all the signal output values 
from the respective pixels corresponding to the 
white portion are 1.0, and all the signal output 
values from the respective pixels corresponding to 
the black portion are zero. 

When the G signal for the pixel at which the R 
...ilter is arranged and the R signal for the pixel 
at which the G filter is arranged are interpolated 
by the above-mentioned interpolation method, the G 
signal and the R signal which have been interpolated 
are as shown in Figs. 13 (d) and 13 (e) . That is, 
it is found that the false chrominance signal is 
generated at the boundary between the white and black 



potions. The most suitable G signal for the pixel 
at which the R filter is arranged and the most 
suitable R signal for the pixel at which the G filter 
is arranged must be as shown in Fig. 13 (f) and 13 

(g) . 

As a measure to avoid the generation of the false 
chrominance signal, a method of making it difficult 
to make the false chrominance signal conspicuous 
utilizing an optical low-pass filter and an 
electrical low-pass filter, and a method of 
restraining a chrominance signal at the above- 
mentioned boundary (edge) are considered (for 
example, Japanese Patent Application No. 1993-8361 
by the applicant of the present invention in the 
latter case) . 

In the method simply utilizing the optical 
low-pass filter, however, the level of the false 
chrominance signal can be lowered. However, the 
frequency characteristics of the signal itself 
obtained from the solid-state image pick-up device 
are also lowered as the level thereof is lowered, 
so that the resolution itself of the obtained signal 
is lowered. In the method utilizing the electrical 
low-pass filter, the level of the false chrominance 
signal can be lowered. On the contrary, an area where 
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the false chrominance signal is generated is 
enlarged. Accordingly, a complete solution is not 
found. In the method of restraining the chrominance 
signal at the boundary, the chrominance signal which 
should inherently exist is also restrained, so that 
a color at the boundary may be lost. 

(2) Therefore, the inventors of the present 
invention have already developed a color separating 
method for providing as interpolation means for 
generating a plurality of chrominance signal 
components at an arbitrary pixel to be processed, 
first interpolation processing means suitable for 
a case where there is a strong correlation in the 
horizontal direction and second interpolation 
processing means suitable for a case where there is 
a strong correlation in the vertical direction, and 
providing first correlated value calculation means 
for calculating a correlated value in the horizontal 
direction at the pixel to be processed and second 
correlated value calculation means for calculating 
the correlated value in the vertical direction of 
the pixel to be processed, for weighting an 
interpolated value found by the first interpolation 
processing means, weighting an interpolated value 
found by the second interpolation processing means. 
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and adding the weighted interpolated values to find 
a plurality of color components for the pixel to be 
processed has already been developed (Japanese 
Patent No. 2931520). 

In a first embodiment described in the Japanese 
Patent, each of the correlated value calculation 
means calculates a correlated value using only a 
signal output value from a pixel at which a G filter 
is arranged. However, the number of pixels at which 
G filters are respectively arranged is one-half of 
the whole number of pixels. If an attempt to 
calculate a correlated value using only the signal 
output value from the pixel at which the G filter 
is arranged is made, therefore, an accurate 
correlated value cannot, in some cases, be 
calculated . 

Therefore, it is considered that correlated 
values are calculated using the signal output values 
from all the pixels. In the case of a monochrome 
image or an image having a low color level, 
therefore, the signal output value from each of the 
pixels at which R, G, and B filters are arranged is 
considered as luminance, thereby making it possible 
to calculate an accurate correlated value. When the 
color level is high, however, the signal output value 



from each of the pixels at which the R, G, and B 
filters are respectively arranged is not considered 
as luminance, thereby making it impossible to 
calculate an accurate correlated value. 

In a third embodiment described in the 
above-mentioned Japanese Patent, correlated values 
are found by weighting and adding both the correlated 
values depending on the color level such that 
correlated values calculated using signal output 
values from all pixels are used when the color level 
is low, while correlated values calculated using 
only a signal output value from a pixel at which a 
G filter is arranged is used when the color level 
is high. 

An object of the present invention is to provide 
a color separation circuit of a single chip color 
camera capable of calculating a correlated value 
higher in precision and preventing a false 
chrominance signal from being generated as well as 
improving color reproducibility. 

(3) In the above-mentioned Japanese Patent No. 
2 9 3 1 5 2 0, i n t e r p o 1 a t i o n p r o c e s s i n g , that is, primary 
color correlated color separation processing is 
performed utilizing the property of the ratio of a 
G signal to an R signal or a B signal being 
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approximately equal between adjacent pixels because 
the local change of a chrominance signal is smaller 
than the change in luminance and the property of the 
ratio of a low-frequency component to a high- 
frequency component of a particular color component 
being equal in the other color component, or 
interpolation processing, that is, color difference 
correlated color separation processing is performed 
utilizing the property of the difference between a 
G signal and an R signal or a B signal being 
approximately equal between adjacent pixels because 
the local change of a chrominance signal is small 
and the property of the difference between a 
1 o w - f r e qu e n c y component and a high-frequency 
component of a particular color component being 
equal in another color component. 

In the primary color correlated color 
separation processing, when a large video signal 
having no correlation with another portion, for 
example, noise is inputted into an input video 
signal, however, interpolation processing is 
•performed through a dividing circuit. Accordingly, 
the noise is emphasized, thereby making it 
impossible to solve R, G, and B dot noises produced 
in a dark portion of an image. 



In the color difference correlated color 
separation processing, when an object having the 
same color is illuminated by lighting, a false 
chrominance signal generated by a luminance change 
at the boundary between an object and a shadow by 
the illumination cannot be solved. 

An object of the present invention^ is to 
provide, in a single chip color video camera using 
a solid-state image pick-up device, a color 
separation circuit for preventing a false 
chrominance signal from being generated in color 
separation processing for generating a plurality of 
chrominance signal components as well as being high 
in sharpness and superior in color reproducibility. 

SUMMARY OF THE INVENTION 
A first color separation circuit of a single 
chip color camera according to the present invention 
is a color separation circuit of a single chip color 
camera for subjecting a signal from a solid-state 
image pick-up device having a plurality of types of 
color filters which differ in spectral sensitivity 
characteristics arranged therein, respectively, so 
as to correspond to pixels to color separation 
processing, characterized by comprising a plurality 
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of types of interpolation processing means for 
respectively producing a plurality of chrominance 
signal components at the arbitrary pixel to be 
processed and suitable for a case where there is a 
strong correlation in each of a plurality of types 
of directions centered at the pixel to be processed 
from the chrominance signal components at the pixel 
to be processed and the pixels around the pixel to 
be processed; correlated value detection means for 
detecting the direction in which there is a strong 
correlation out of the plurality of types of 
directions centered at the pixel to be processed on 
the basis of the chrominance signal components at 
the pixel to be processed and the pixels around the 
pixel to processed; and means for finding the 
plurality of chrominance signal components at the 
pixel to be processed on the basis of the direction 
in which there is a strong correlation which is 
detected by the correlated value detection means and 
each of the chrominance signal components produced 
by the interpolation processing means, gain control 
means for controlling a gain for each of the color 
filters being provided in a stage preceding the 
correlated value detection means, the correlated 
value detection means detecting the direction in 
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which there is a strong correlation out of the 
plurality of types of directions centered at the 
pixel to be processed on the basis of signals at all 
the pixels in a block composed of M by N pixels 
centered at the pixel to be processed which are 
inputted through the gain control means. 

An example of the gain control means is one for 
carrying out the gain control on the basis of color 
information obtained from the whole of a screen. In 
this case, used as each of the interpolation means 
may be one for calculating the plurality of 
chrominance signal components at the pixel to be 
processed on the basis of the chrominance signal 
components at the pixel to be processed and the 
pixels around the pixel to be processed after the 
gain control processing is performed by the gain 
control means. 

Used as the gain control means may be one for 
dividing a screen into a plurality of areas and 
controlling the gain for each of the color filters 
on the basis of the results of integration of 
chrominance signals for the areas. 

A second color separation circuit of a single 
chip color camera according to the present invention 
is a color separation circuit of a single chip color 



1 1 



camera for subjecting a signal from a solid-state 
image pick-up device having a plurality of types of 
color filters which differ in spectral sensitivity 
characteristics arranged therein, respectively, so 
as to correspond to pixels to color separation 
processing, characterized by comprising first 
interpolation processing means for producing a 
plurality of chrominance signal components at the 
arbitrary pixel to be processed and suitable for a 
case where there is a strong correlation in the 
horizontal direction at the pixel to be processed 
from chrominance signal components at the pixel to 
be processed and the pixels around the pixel to be 
processed; second interpolation processing means 
for producing a plurality of chrominance signal 
components at the pixel to be processed and suitable 
for a case where there is a strong correlation in 
the vertical direction at the pixel to be processed 
from the chrominance signal components at the pixel 
to be processed and the pixels around the pixel to 
be processed; correlated value calculation means for 
calculating correlated values in the horizontal 
direction and the vertical direction at the pixel 
to be processed on the basis of the chrominance 
signal components at the pixel to be processed and 
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the pixels around the pixel to processed; and 
weighting and addition means for weighting each of 
the chrominance signal components produced by the 
first interpolation processing means, weighting 
each of the chrominance signal components produced 
by the second interpolation processing means, and 
adding the weighted chrominance signal components 
depending on the correlated values in the horizontal 
direction and the vertical direction which are 
calculated by the correlated value calculation 
means, to find the plurality of chrominance signal 
components at the pixel to be processed, gain control 
means for controlling a gain for each of the color 
filters being provided in a stage preceding the 
correlated value detection means, the correlated 
value calculation means calculating the correlated 
values in the horizontal direction and the vertical 
direction at the pixel to be processed on the basis 
of signals at all the pixels in a block composed of 
M by N pixels centered at the pixel to be processed 
which are inputted through the gain control means. 

An example of the gain control means is one for 
carrying out the gain control on the basis of color 
information obtained from the whole of a screen. In 
this case, used as the first interpolation means and 
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the second interpolation means may be one for 
calculating a plurality of chrominance signal 
components at the pixel to be processed on the basis 
of the chrominance signal components at the pixel 
to be processed and the pixels around the pixel to 
be processed after the gain control processing is 
performed by the gain control means. 

Used as the gain control means may be one for 
dividing a screen into a plurality of areas and 
controlling the gain for each of the color filters 
on the basis of the results of integration of 
chrominance signals for the areas. 

In a color separation circuit of a single chip 
color camera for processing a signal from a 
solid-state image pick-up device having a plurality 
of types of color filters which differ in spectral 
sensitivity characteristics arranged in a Mosaic 
shape therein, respectively, so as to correspond to 
pixels through an automatic gain control circuit for 
carrying out gain control, a third color separation 
circuit of the single chip color camera according 
to the present invention is characterized by 
comprising two or more types of color separation 
means, which differ in a chrominance signal 
component producing system, provided in order to 
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produce a plurality of chrominance signal components 
at the arbitrary pixel to be processed on the basis 
of chrominance signal components at the pixel to be 
processed and the pixels around the pixel to be 
processed; and synthesis means for synthesizing the 
chrominance signal components respectively 
produced by the color separation means on the basis 
of the signal from the solid-state image pick-up 
device . 

An example of the synthesis means is one for 
synthesizing the chrominance signal components 
produced by the respective color separation means 
on the basis of the level of the signal from the 
solid-state image pick-up device. 

An example of the synthesis means is one for 
synthesizing the chrominance signal components 
produced by the respective color separation means 
on the basis of the gain, of the automatic gain 
control circuit, corresponding to the level of the 
signal from the solid-state image pick-up device. 

Examples of the color separation means to be 
provided are primary color correlated color 
separation means for producing a plurality of 
chrominance signal components at the arbitrary pixel 
to be processed utilizing the correlation of the 
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ratio of colors in the horizontal direction or the 
vertical direction on the basis of the chrominance 
signal components at the pixel to be processed and 
the pixels around the pixel to be processed and color 
difference correlated color separation means for 
producing the plurality of chrominance signal 
components at the arbitrary pixel to be processed 
utilizing the correlation of the difference between 
colors in the horizontal direction or the vertical 
direction on the basis of the chrominance signal 
components at the pixel to be processed and the 
pixels around the pixel to be processed. 

In this case, an example of the synthesis means 
is one for synthesizing the chrominance signal 
components produced by both the color separation 
means such that each of the chrominance signal 
components produced by the primary color correlated 
color separation means is increased when the level 
of the signal from the solid-state image pick-up 
device is high, while synthesizing the chrominance 
signal components produced by both the color 
separation means such that each of the chrominance 
signal components produced by the color difference 
correlated color separation means is increased when 
the level of the signal from the solid-state image 
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pick-up device is low. 

Alternatively, an example of the synthesis 
means is one for synthesizing the chrominance signal 
components produced by both the color separation 
means such that each of the chrominance signal 
components produced by the color difference 
correlated color separation means is increased when 
the gain, of the automatic gain control circuit, 
corresponding to the level of the signal from the 
solid-state image pick-up device is large, while 
synthesizing the chrominance signal components 
produced by both the color separation means such that 
each of the chrominance signal components produced 
by the primary color correlated color separation 
means is increased when the gain of the automatic 
gain control circuit is small. 

There may be provided correlated value 
detection means for finding correlated values in the 
horizontal direction and the vertical direction at 
the pixel to be processed, each of the primary color 
correlated color separation means and the color 
difference correlated color separation means may 
comprise horizontal direction processing means for 
producing a chrominance signal component suitable 
for a case where there is a strong correlation in 



the horizontal direction and vertical direction 
processing means for producing a chrominance signal 
component suitable for a case where there is a strong 
correlation in the vertical direction, and each of 
the primary color correlated color separation means 
and the color difference correlated color separation 
means may weight each of the chrominance signal 
components produced by the horizontal direction 
processing means, weight each of the chrominance 
signal components produced by the vertical direction 
processing means, and add the weighted chrominance 
signal components depending on the correlated values 
in the horizontal direction and the vertical 
direction which are detected by the correlated value 
detection means, to find a plurality of chrominance 
signal components at the pixel to be processed. 

Examples of the color separation means to be 
provided are primary color correlated color 
separation means for producing a plurality of 
chrominance signal components at the arbitrary pixel 
to be processed utilizing the correlation of the 
ratio of colors in the horizontal direction or the 
vertical direction on the basis of the chrominance 
signal components at the pixel to be processed and 
the pixels around the pixel to be processed, and 



color difference correlated color separation means 
for producing the plurality of chrominance signal 
components at the arbitrary pixel to be processed 
utilizing the correlation of the difference between 
colors in the horizontal direction or the vertical 
direction on the basis of the chrominance signal 
components at the pixel to be processed and the 
pixels around the pixel to be processed. 

In this case, an example of the synthesis means 
is one for synthesizing the chrominance signal 
components produced by both the color separation 
means such that each of the chrominance signal 
components produced by the adaptive correlated color 
separation means is increased when the level of the 
signal from the solid-state image pick-up device is 
high, while synthesizing the chrominance signal 
components produced by both the color separation 
means such that each of the chrominance signal 
components produced by the color difference 
correlated color separation means is increased when 
the level of the signal from the solid-state image 
pick-up device is low. 

Alternatively, an example of the synthesis 
means is one for synthesizing the chrominance signal 
components produced by both the color separation 
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means such that each of the chrominance signal 
components produced by the color difference 
correlated color separation means is increased when 
the gain, of the automatic gain control circuit, 
corresponding to the level of the signal from the 
solid-state image pick-up device is large, while 
synthesizing the chrominance signal components 
produced by both the color separation means such that 
each of the chrominance signal components produced 
by the adaptive correlated color separation means 
is increased when the gain of the automatic gain 
control circuit is small. 

There may be provided correlated value 
detection means for finding correlated values in the 
horizontal direction and the vertical direction at 
the pixel to be processed, each of the adaptive 
correlated color separation means and the color 
difference correlated color separation means may 
comprise horizontal direction processing means for 
producing a chrominance signal component suitable 
for a case where there is a strong correlation in 
the horizontal direction and vertical direction 
processing means for producing a chrominance signal 
component suitable for a case where there is a strong 
correlation in the vertical direction, and each of 



the adaptive correlated color separation means and 
the color difference correlated color separation 
means may weight each of the chrominance signal 
components produced by the horizontal direction 
processing means, weight each of the chrominance 
signal components produced by the vertical direction 
processing means, and add the weighted chrominance 
signal components depending on the correlated values 
in the horizontal direction and the vertical 
direction which are detected by the correlated value 
detection means, to find the plurality of 
chrominance signal components at the pixel to be 
processed. 

The foregoing and other objects, features, 
aspects and advantages of the present invention will 
become more apparent from the following detailed 
description of the present invention when taken in 
conjunction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a block diagram showing a color 

separation circuit according to a first embodiment; 
Fig. 2 is a schematic view showing the 

configuration of a CCD 1 and its driving circuit; 

Fig. 3 is a timing chart showing an input signal 
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and an output signal of a selection circuit 18; 

Fig. 4 is a block diagram showing the basic 
configuration of a horizontal interpolation circuit 
24, a vertical interpolation circuit 25, a 
horizontal direction correlated value calculation 
circuit 28, and a vertical direction correlated 
value calculation circuit 29; 

Fig. 5 is a schematic view for selecting the 
pattern of pixels composing a block to be processed 
in the horizontal interpolation circuit 24, the 
vertical interpolation circuit 25, the horizontal 
direction correlated value calculation circuit 28, 
and the vertical direction correlated value 
calculation circuit 29; 

Fig. 6 is a schematic view for explaining a 
primary color correlation processing method by the 
horizontal interpolation circuit 24 and the vertical 
interpolation circuit 25; 

Fig. 7 is a schematic view for explaining a 
method of calculating a correlated value using all 
signals by the horizontal direction correlated value 
calculation circuit 28 and the vertical direction 
correlated value calculation circuit 29; 

Fig. 8 is a block diagram showing a color 
separation circuit in a second embodiment; 
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Fig. 9 is a block diagram showing a color 
separation circuit in a third embodiment; 

Fig. 10 is a schematic view showing a plurality 
of RGB integration areas set in a screen; 

Fig. 11 is a schematic view for explaining a 
method of calculating R, G, and B gains for a 
predetermined pixel; 

Fig. 12 is a block diagram showing a color 
p. separation circuit according to a fourth embodiment; 

Fig. 13 is a schematic view for explaining 

ry- 

conventional color separation processing; 
'=2 Fig. 14 is a block diagram showing a color 

separation circuit according to a fifth embodiment; 

Fig. 15 is a schematic view showing the 
configuration of a CCD 1 and its driving circuit; 

Fig. 16 is a timing chart showing an input signal 
and an output signal of a selection circuit 18; 

Fig. 17 is a block diagram showing the 
configuration of a primary color correlated color 
separator 24; 

Fig. 18 is a block diagram showing the 
configuration of a color difference correlated color 
separator 25; 

Fig. 19 is a block diagram showing the basic 
configuration of a p r i m a r y - c o 1 o r - c o r r e 1 a t i o n 
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horizontal interpolation circuit 26, a primary- 
col o r - c o r r e 1 a t i o n vertical interpolation circuit 
27, a c o 1 o r - d i f f e r e n c e - c o r r e 1 a t i o n horizontal 
interpolation circuit 29, a c o 1 o r - d i f f e r e n c e - 
correlation vertical interpolation circuit 30, a 
horizontal direction correlation detection circuit 
23a, and a vertical direction correlation detection 
circuit 23b; 

Fig. 20 is a schematic view for selecting the 
pattern of pixels composing a block to be processed 
in the p r i m a r y - c o 1 o r - c o r r e 1 a t i o n horizontal 
interpolation circuit 26, the p r i m a r y - c o 1 o r - 
correlation vertical interpolation circuit 27, the 
color-difference-correlation horizontal 
interpolation circuit 29, the c o 1 o r - d i f f e r e n c e - 
correlation vertical interpolation circuit 30, the 
horizontal direction correlation detection circuit 
23a, and the vertical direction correlation 
detection circuit 23b,- 

Fig. 21 is a schematic view for explaining a 
primary color correlation processing method by the 
primary-color-correlation horizontal 

interpolation circuit 26 and the p r i m a r y - c o 1 o r - 
correlation vertical interpolation circuit 27; 

Fig. 22 is a schematic view for explaining a 
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method of calculating a correlated value using only 
a G signal by the horizontal direction correlation 
detection circuit 23a and the vertical direction 
correlation detection circuit 23b; 

Fig. 23 is an illustration for explaining the 
effect of the invention; 

Fig. 24 is an illustration for explaining 
interpolation processing; 

Fig. 25 is an illustration for explaining the 
effect of the invention; 

Fig. 26 is an illustration for explaining the 
operations of a horizontal interpolation circuit 26 
and a vertical interpolation circuit 27 in a sixth 
embodiment ; 

Fig. 27 is an illustration for explaining the 
operations of a horizontal interpolation circuit 29 
and a vertical interpolation circuit 30 in a sixth 
embodiment ; 

Fig. 28 is an illustration for explaining the 
operations of a horizontal interpolation circuit 26 
and a vertical interpolation circuit 27 in a seventh 
embodiment ; 

Fig. 29 is a schematic view showing a plurality 
of chroma detection areas previously set; 

Fig. 30 is a graph showing the relationship 
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between a chroma integrated value C and a chromatic 
c o 1 o r / a c h r o m a t 1 c color judged value R^; and 
Fig. 31 is a block diagram showing the 
configuration of an eighth embodiment. 



DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[A] Description of First to Fourth Embodiments 

Referring now to Figs. 1 to 12, first to fourth 
embodiments of the present invention will be 
described . 

[A-1] Description of Idea of the Present 
Invention 

Also in the present invention, the direction of 
a correlation between a signal at a pixel to be 
processed on a CCD and a signal at pixels around the 
pixel to be processed is basically detected 
utilizing a correlation between images, to generate 
chrominance signals (RGB signals) by an 
interpolation processing method suitable for the 
detected direction of the correlation, as in the 
invention described in Japanese Patent (No. 2931520) 
referred to in "Description of the Prior Art". 

The present invention differs from the prior 
art in that correlated values are calculated on the 
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basis of signal output values from all pixels 
irrespective of the color level. In a case where 
the correlated values are calculated on the basis 
of the signal output values from all pixels, as 
described above, accurate correlated values cannot 
be calculated when the color level is high. 
Accordingly, the present invention is characterized 
in that correlated values are calculated using 
signals which have been subjected to gain control 
for each color filter. 

That is, the present invention is characterized 
in that a gain control circuit for each color filter 
is provided in a stage preceding a circuit for 
calculating a correlated value (correlated value 
calculation means) . Example of the gain control 
circuit is one for carrying out uniform gain control 
over the entire screen (calculating the most 
suitable gain by screen to control the gain) and one 
for dividing a screen into a plurality of areas and 
calculating the most suitable gain for each of the 
areas to control the gain. 

In a case where the screen is divided into the 
plurality of areas, and the most suitable gain is 
calculated for each of the areas to control the gain, 
the correlated value calculation precision is 

2 7 



improved with respect to a partially colored image, 
as compared with that in a case where the most 
suitable gain is calculated by screen to control the 
gain. 

Generally in a color camera, a CCD signal is 
subjected to white balance processing on the basis 
of color information on the entire screen after color 
separation processing. In a case where used as a 
gain control circuit for enhancing the correlated 
value calculation precision is one for carrying out 
gain control by screen, if the gain control circuit 
is provided in a stage preceding interpolation means 
for color separation, to feed an output of the gain 
control circuit to the interpolation means and 
correlated value calculation means, white balance 
processing can be omitted after the color separation 
processing . 

On the other hand, in a case where used as a gain 
control circuit for enhancing the correlated value 
calculation precision is one for dividing a screen 
into a plurality of areas and calculating the most 
suitable gain for each of the areas to control the 
gain, a signal obtained before the gain control is 
carried out must be inputted to interpolation means, 
whereby white balance processing must be performed 
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after the color separation processing. 

Four types of embodiments will be described: 

(1) First embodiment; a case where an example 
of a gain control circuit for each color filter for 
enhancing the correlated value calculation 
precision is one for carrying out gain control for 
each color filter by screen, and an example of a CCD 
is one using a CCD for simultaneously reading out 
two lines 

(2) Second embodiment; a case where an example 
of a gain control circuit for each color filter for 
enhancing the correlated value calculation 
precision is one for carrying out gain control for 
each color filter by screen, and an example of a CCD 
is a CCD for independently reading out all pixels 
(a progressive scan CCD) 

(3) Third embodiment; a case where an example 
of a gain control circuit for each color filter for 
enhancing the correlated value calculation 
precision is one for dividing a screen into a 
plurality of areas to carry out gain control for each 
color filter by areas, and an example of a CCD is 
a CCD for simultaneously reading out two lines 

(4) Fourth embodiment; a case where an example 
of a gain control circuit for each color filter for 

2 9 



enhancing the correlated value calculation 
precision is one for dividing a screen into a 
plurality of areas to carry out gain control for each 
color filter by areas, and an example of a CCD is 
a CCD for independently reading out all pixels 

[A-2] Description of First Embodiment 

An embodiment in a case where used as a gain 
control circuit for each color filter for enhancing 
the correlated value calculation precision is one 
for carrying out gain control for each filter by 
screen, and used as a CCD (Charge Coupled Device) 
is a CCD for simultaneously reading out two lines 
will be described. 

Fig. 1 illustrates the configuration of the CCD 
and a color separation circuit. 

The CCD 1 is provided with an imaging unit 2 and 
horizontal transfer units 7 and 8. 

Fig. 2 illustrates the configuration of the CCD 
1 and its driving circuit. 

The imaging unit 2 is constituted by 
photodiodes 4 for performing photoelectric 
conversion and vertical transfer CCDs 5. Each of 
the photodiodes 4 comprises color filters in an 
arrangement, as indicated by R, G, and B. A vertical 
transfer CCD 5 is driven by a vertical driving 
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circuit 6 outside the CCD. 

The horizontal transfer unit has a dual channel 
structure using the first horizontal transfer CCD 
7 and the second horizontal transfer CCD 8, so that 
signals corresponding to two lines are 
simultaneously obtained. The horizontal transfer 
CCDs 7 and 8 are driven by a horizontal driving 
circuit 9 outside the CCD 1. 

Signals from the horizontal transfer units 7 
and 8 are respectively converted into digital 
signals by A/D { A n a 1 o g - t o - D i g i t a 1 ) conversion 
circuits 14 and 15 after being processed by CDSs 
(Correlation Double Sampling Circuits) 10 and 11 and 
AGCs (Automatic Gain Control Circuits) 12 and 13. 

A signal DO outputted from the one A/D 
conversion circuit 14 is fed to a first selection 
circuit 19 in a selection circuit 18, and is fed to 
a first IH delay circuit 16. A signal Dl outputted 
from the other A/D conversion circuit 15 is fed to 
first and second selection circuits 19 and 20 in the 
selection circuit 18, and is fed to a second IH delay 
circuit 17. 

Each of the IH delay circuits 16 and 17 is a 
memory capable of storing an input signal 
corresponding to IH (one horizontal period) . A 



signal which is delayed by IH from the input signal 
is outputted from each of the IH delay circuits 16 
and 17. Signal writing and signal read-out to and 
from the IH delay circuit are performed in 
synchronization with horizontal transfer by the CCD 
1. Therefore, a timing generation circuit 71 and 
a synchronizing signal generation circuit 70 for 
controlling the operation of the CCD 1 are 
synchronously operated. 

A timing pulse for driving the CCD, and an odd 
pixel/even pixel identification signal, and a clock 
signal are outputted from the timing generation 
circuit 71. HD (a horizontal synchronizing signal) , 
VD (a vertical synchronizing signal) , and a field 
identification signal are outputted from the 
synchronizing signal generation circuit 70. The 
operation of another circuit portion is controlled 
by an output signal from the synchronizing signal 
generation circuit 70. In the second embodiment and 
the fourth embodiment, an odd line/even line 
identification signal is outputted from the timing 
generation circuit 71, to control a selection 
circuit 108 in place of the filed identification 
signal outputted from the synchronizing signal 
generation circuit 70 (see Figs. 8 and 12). 



An output D2 of the first IH delay circuit 16 
is fed to second and third selection circuits 20 and 
21 in the selection circuit 18. An output D3 of the 
second IH delay circuit 17 is fed to the third 
selection circuit 21 in the selection circuit 18. 

The selection circuit 18 selects digital 
signals corresponding to three lines from digital 
signals corresponding to four lines depending on 
whether the type of field is an odd field or an even 
u3 field, and outputs the selected digital signal. The 

ru - 

'CQ selection circuits 19, 20, and 21 in the selection 

•'5 circuit 18 are controlled on the basis of the field 

identification signal representing the type of field 

I'^f outputted from the synchronizing signal generation 

'!r circuit 70. 

That is, the signals Dl, D2, and D3 are selected 
in odd fields, and signals DO, Dl, andD2 are selected 
in even fields. More specifically, when the field 
identification signal indicates an odd field (for 
example, a low-level signal) , the first selection 
circuit 19 selects the signal Dl, the second 
selection circuit 20 selects the signal D2, and the 
third selection circuit 21 selects the signal D3. 
Conversely, when the field identification signal 
indicates an even field (for example, a high-level 
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signal) , the first selection circuit 19 selects the 
signal DO, the second selection circuit 20 selects 
the signal Dl, and the third selection circuit 21 
selects the signal D2. In this way, signals LO, Ll, 
and L2 corresponding to three lines, which 
correspond to the even and odd fields, are outputted 
from the selection circuit 18. 

Fig. 3 illustrates the operation of the 
selection circuit 18. 

(a) shown in Fig. 3 indicates the horizontal 
synchronizing signal (HD) in the odd field. (f) 
indicates the field identification signal, which is 
at a low level because it is in the odd field. 

(b) to (e) shown in Fig. 3 respectively indicate 
the input signals D3, D2, Dl, and DO to the selection 
circuit 18 in the odd fields. When a field including 
an input image is the odd field, the signals D3, D2, 
and Dl are outputted from the selection circuit 18 
as the signals L2, Ll, and LO. 

In the odd field, when a signal on the fourth 
line is inputted as DO, 03 corresponds to the first 
line, 02 corresponds to the second line, Dl 
corresponds to the third line, and DO corresponds 
to the fourth line, so that the signals on the first, 
second, and third lines are selected. Then, D3 
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corresponds to the third line, D2 corresponds to the 
fourth line, Dl corresponds to the fifth line, and 
DO corresponds to the sixth line, so that the signals 
on the third, fourth, and fifth lines are selected. 

(g) shown in Fig. 3 indicates the horizontal 
synchronizing signal (HD) in the even field. (1) 
indicates the field identification signal, which is 
at a high level because it is in the even field. 

(h) to (k) shown in Fig. 3 respectively indicate 
the input signals D3, D2, Dl, and DO to the selection 
circuit 18 in the even fields. When a field including 
an input image is the even field, the signals D2, 
Dl, and DO are outputted from the selection circuit 
18 as the signals L2, LI, and LO. 

In the even field, when a signal on the fourth 
line is inputted as DO, D3 corresponds to the first 
line, D2 corresponds to the second line, Dl 
corresponds to the third line, and DO corresponds 
to the fourth line, so that the signals on the second, 
third, and fourth lines are selected. Then, D3 
corresponds to the third line, D2 corresponds to the 
fourth line, Dl corresponds to the fifth line, and 
DO corresponds to the sixth line, so that the signals 
on the fourth, fifth, and sixth lines are selected. 

The outputs LO, LI, and L2 of the selection 
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circuit 18 are respectively fed to multipliers 101, 

102, and 103. Each of the multipliers 101, 102, and 

103, together with an RGB integration circuit 104, 
a microcomputer 105, and three selection circuits 
106, 107, and 108, constitutes a gain control circuit 
for carrying out gain control for each color filter. 
In this example, an example of the gain control 
circuit is one for carrying out gain control for each 
color filter by screen on the basis of color 
information obtained from the entire screen. 
Accordingly, the gain control circuit is also used 
as a white balance processing circuit. 

Specifically, the outputs LO, LI, and L2 of the 
selection circuit 18 are subjected to gain control 
for each color filter by screen by the gain control 
circuit. That is, gains are respectively applied 
to the outputs LO, LI, and L2 of the selection circuit 
18 by the multipliers 101, 102, and 103 such that 
the respective integrated values of R, G, and B 
signals in one screen are constant. The details of 
the gain control circuit will be described later. 
Here, the digital multipliers 101, 102, and 103 are 
used as multipliers for carrying out gain control 
(white balance processing) for each color filter by 
screen. When the AGC circuits 12 and 13 can carry 
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out gain control for each of the R, G, and B signals, 
however, white balance processing can be also 
performed utilizing the AGC circuits 12 and 13. 

Outputs LO', LI', and L2' of the respective 
multipliers 101, 102, and 103 are fed to 
interpolation processing means 22 and correlated 
value calculation means 23. 

The interpolation processing means 22 is 
provided with a horizontal interpolation circuit 24 
and a vertical interpolation circuit 25. The 
horizontal interpolation circuit 24 performs 
interpolation processing suitable for a case where 
there is a strong correlation in the horizontal 
direction on the basis of output signals, from the 
CCD 1, corresponding to three lines, to generate 
three chrominance signals Gh, Rh , and Bh for 
respective pixels. The vertical interpolation 
circuit 25 performs interpolation processing 
suitable for a case where there is a strong 
correlation in the vertical direction on the basis 
of output signals, from the CCD 1, corresponding to 
three lines, to generate three chrominance signals 
Gv, Rv , and Bv for respective pixels. 

The case where there is a strong correlation in 
the horizontal direction means a case where there 



is a strong correlation in the horizontal direction, 
but there is little correlation in the vertical 
direction, as in a fine h o r i z o n t a 1 1 y - s t r i p e d image. 
On the other hand, the case where there is a strong 
correlation in the vertical direction means a case 
where there is a strong correlation in the vertical 
direction, but there is little correlation in the 
horizontal direction, as in a fine vertically- 
striped image. The details of each of the 
interpolation circuits 24 and 25 will be described 
later. 

The correlated value calculation means 23 is 
provided with a horizontal direction correlated 
value calculation circuit 28 and a vertical 
direction correlated value calculation circuit 29. 
The horizontal direction correlated value 
calculation circuit 28 calculates a c o r r e 1 a t e d v a 1 u e 
in the horizontal direction (hereinafter referred 
to as a horizontal direction correlated value) Sh 
on the basis of a differential signal in the 
horizontal direction (e.g., the absolute value of 
a secondary differential signal in the horizontal 
direction) . The vertical direction correlated value 
calculation circuit 29 calculates a correlated value 
in the vertical direction (hereinafter referred to 



as a vertical direction correlated value) Sv on the 
basis of a differential signal in the vertical 
direction {e.g., the absolute value of a secondary 
differential signal in the vertical direction) . The 
details of each of the correlated value calculation 
circuits 28 and 29 will be described later. 

The horizontal direction correlated value Sh 
and the vertical direction correlated value Sv are 
fed to factor calculation means 26. In the factor 
calculation means 26, a weighting factor Kh 
corresponding to the horizontal direction and a 
weighting factor Kv corresponding to the vertical 
direction are respectively calculated on the basis 
of both the correlated values Sh and Sv. The 
weighting factors Kh and Kv are fed to weighting and 
addition means 27. 

The chrominance signals Gh, Rh , and Bh 
outputted from the horizontal interpolation circuit 

24 and the chrominance signals Gv, Rv , and Bv 
outputted from the vertical interpolation circuit 

25 are fed to the weighting and addition means 27. 
The weighting and addition means 27 multiplies the 
chrominance signals Gh, Rh, and Bh by the factor Kh, 
and multiples the chrominance signals Gv , Rv , and 
Bv by the factor Kv, adds the respective results of 
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the multiplication of the signals in the same colors 
(Gh and Gv, Rh and Rv , and Bh and Bv) by the factors, 
and outputs the results of the addition as final 
chrominance signals Go, Ro, and Bo. 

Specifically, interpolation processing for 
separating the chrominance signals is controlled on 
the basis of the correlated values in the horizontal 
direction and the vertical direction. 
1=3 [A-2-1] Description of the gain control 

Q circuit (white balance processing circuit) for each 

ru 

Cm color filter 

The RGB integration circuit 104 calculates an 
integrated value for each of the R, G, and B signals 

'0 

for each field on the basis of the output signals 
LO and LI of the selection circuit 18. The integrated 
value for each of the R, G, and B signals which is 
calculated by the RGB integration circuit 104 is fed 
to the microcomputer 105. 

The microcomputer 105 calculates gains 
respectively corresponding to the R, G, and B signals 
and outputs the calculated gains, for each field, 
on the basis of the integrated value for each of the 
R, G, and B signals, which is fed from the RGB 
integration circuit 104, such that the integrated 
value for each of the R, G, andB signals is a constant 
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value . 

The microcomputer 105 may calculate an 
integrated value for each of the R, G, and B signals 
which corresponds to one field on the basis of the 
R, G, and B signals most newly fed from the RGB 
integration circuit 104 and the integrated value for 
each of the R, G, and B signals which is fed in the 
past from the RGB integration circuit 104, and may 
calculate gains respectively corresponding to the 
R, G, and B signals and output the calculated gains 
for each field such that the integrated value for 
each of the calculated R, G, and B signals is a 
constant value. 

Meanwhile, in the first embodiment using the 
CCD for simultaneously reading out two lines as the 
CCD 1, it is determined which of the R, G, and B 
signals is each of the signals LO, Ll, and L2 
outputted from the selection circuit 18 depending 
on whether the type of field is an odd field or an 
even field and whether a pixel corresponding to each 
of the signals LO, Ll, and L2 is an odd-numbered pixel 
or an e v e n - n u mb e r e d pixel on a horizontal line. 

Specifically, as shown in Fig. 3, when the type 
of field is an odd field, and the pixel corresponding 
to each of the signals LO, Ll, and L2 is an odd- 
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numbered pixel on the horizontal line, the signals 
LO and L2 are G signals, and the signal LI is a B 
signal. When the type of field is an even field, 
and the pixel corresponding to each of the signals 
LO, Ll, and L2 is an e v e n - n u mb e r e d pixel on the 
horizontal line, the signals LO and L2 are R signals, 
and the signal Ll is a G signal. 

When the type of field is an even field, and the 
pixel corresponding to each of the signals LO, Ll, 
and L2 is an o d d - n u mb e r e d pixel on the horizontal 
line, the signals LO and L2 are B signals, and the 
signal Ll is a G signal. When the type of field is 
an even field, and the pixel corresponding to each 
of the signals LO, Ll, and L2 is an e v e n - n u mb e r e d 
pixel on the horizontal line, the signals LO and L2 
are G signals, and the signal Ll is an R signal. 

The three selection circuits 106, 107, and 108 
select and control, such that the R gain, the G gain, 
and the B gain are respectively fed to the R signal 
corresponding to an R pixel, the G signal 
corresponding to a G pixel, and the B signal 
corresponding to a B pixel, the inputted gains on 
the basis of the field identification signal for 
judging whether the type of field is an odd field 
or an even field and the odd pixel/even pixel 
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identification signal for judging whether a pixel 
corresponding to each of the signals LO, LI, and L2 
is an odd-numbered pixel or an e v e n - n u mb e r e d pixel 
on the horizontal line. 

Specifically, the gain (G gain) corresponding 
to the G signal outputted from the microcomputer 105 
is fed to the selection circuit 106 and the selection 
circuit 107. The gain (R gain) corresponding to the 
R signal outputted from the microcomputer 105 is fed 
to the selection circuit 106. The gain (B gain) 
corresponding to the B signal outputted from the 
microcomputer 105 is fed to the selection circuit 
10 7. 

The odd pixel/even pixel identification signal 
indicating whether each of the signals LO, Ll, and 
L2 outputted from the selection circuit 18 
corresponds to an odd-numbered pixel or an even- 
numbered pixel is inputted from the timing 
generation circuit 71 to each of the selection 
circuits 106 and 107. 

When the odd pixel/even pixel identification 
signal indicates that the signal corresponds to an 
odd-numbered pixel, the selection circuit 106 
selects the G gain, and the selection circuit 107 
selects the B gain. When the odd pixel/even pixel 
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identification signal indicates that the signal 
corresponds to an e v e n - n u mb e r e d p i x e 1 , the selection 
circuit 106 selects the R gain, and the selection 
circuit 107 selects the G gain. Outputs of both the 
selection circuits 106 and 107 are fed to the 
selection circuit 108. The field identification 
signal representing the type of field is inputted 
from the synchronizing signal generation circuit 70 
to the selection circuit 108. 

The selection circuit 108 feeds, when the field 
identification signal represents an odd field, the 
output of the selection circuit 108 to the multiplier 

101 corresponding to the signal LO and the multiplier 
103 corresponding to the signal L2, and feeds the 
output of the selection circuit 107 to the multiplier 

102 corresponding to the signal LI. 

When the field is an odd field, and the pixel 
corresponding to each of the signals LO, LI, and L2 
is an odd-numbered pixel, therefore, the signal LO 
and the signal L2 are multiplexed by the G gain, and 
the signal LI is multiplexed by the B gain. When 
the field is an odd field, and the pixel 
corresponding to each of the signals LO, LI, and L2 
is an e V e n - n umb e r e d pixel, the signal LO and the 
signal L2 are multiplexed by the R gain, and the 



signal LI is multiplexed by the G gain. 

When the field identification signal 
represents an even field, the selection circuit 108 
feeds the output of the selection circuit 107 to the 
multiplier 101 corresponding to the signal LO and 
the multiplier 103 corresponding to the signal L2, 
and feeds the output of the selection circuit 106 
to the multiplier 102 corresponding to the signal 
L 1 . 

When the type of field is an even field, and the 
pixel corresponding to each of the signals LO, LI, 
and L2 is an odd-numbered pixel, therefore, the 
signal LO and the signal L2 are multiplexed by the 
B gain, and the signal LI is multiplexed by the G 
gain. When the type of field is an even field, and 
the pixel corresponding to each of the signals LO, 
LI, and L2 is an e v e n - n u mb e r e d pixel, the signal LO 
and the signal L2 are multiplexed by the G gain, and 
the signal Ll is multiplexed by the R gain. 

Consequently, each of the signals LO, Ll, and 
L2 outputted from the selection circuit 18 is 
subjected to gain control processing (white balance 
processing) for each color filter. 

[A-2-2] Description of the horizontal 
interpolation circuit 24 and the vertical 
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interpolation circuit 25 

In the present embodiment, chrominance signals 
in three colors corresponding to one pixel at the 
center of a block composed of 3 by 3 pixels are 
produced on the basis of signals from the nine pixels 
in the block. 

Each of the horizontal interpolation circuit 24 
and the vertical interpolation circuit 25 is 
basically constituted by a digital processing 
circuit composed of a block as shown in Fig. 4. 
Reference numerals 30 and 31 shown in Fig. 4 denote 
delay means comprising delay time egual to time 
required for one pixel to be transmitted, and 
reference numeral 32 denotes operation means. 

That is, the signals LO', LI', andL2' outputted 
from the multipliers 101, 102, and 103 are inputted 
to the delay means 30 and 31, whereby the signals 
corresponding to the nine pixels are simultaneously 
fed to the operation means 32. Interpolation 
processing is performed by the operation means 32. 
Generally after color separation processing, white 
balance processing is performed. In the present 
embodiment, however, gain control (white balance 
processing) for each color filter by screen is 
carried out in a stage preceding the interpolation 

4 6 



means 22 in order to improve the precision of 
correlated values. Accordingly, no white balance 
processing is performed after the color separation 
processing . 

Fig. 5 is a diagram showing the relationship 
between an arrangement of pixels on the CCD 1 and 
the selected pixels. 

At the time of odd fields, line signals Dl, D2, 
and D3 are selected. Accordingly, a block composed 
of 3 by 3 pixels which is subjected to odd-numbered 
processing is as shown in Fig. 5 (b) , and a block 
which is subjected to e v e n - n u mb e r e d processing is 
as shown in Fig. 5 (c). 

On the other hand, at the time of even fields, 
line signals DO, Dl, and D2 are selected. 
Accordingly, a block which is subjected to odd- 
numbered processing is as shown in Fig. 5 (d) , and 
a block which is subjected to e v e n - n umb e r e d 
processing is as shown in Fig. 5 (e) . 

Fig. 6 illustrates an operation expression used 
by the horizontal interpolation circuit 24 and the 
vertical interpolation circuit 25 when a block to 
be processed is an odd-numbered block or an 
e ve n - n umb e r e d block in an odd field. 

In the following description, gain control 
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processing for each color filter by screen shall be 
referred to as white balance processing. rik 
represents a signal value after the white balance 
processing for a pixel Rik, gik represents a signal 
value after the white balance processing for a pixel 
Gik, and bik represents a signal value after the 
white balance processing for a pixel Bik. 

When the block to be processed is an odd- 
numbered block in the odd field, Gh, Bh, and Rh for 
a center pixel (a pixel to be processed) G22 are 
calculated in the following manner in the horizontal 
interpolation circuit 24. 

That is, a signal g22 after the white balance 
processing at the pixel to be processed G22 is used 
as Gh for the pixel to be processed G22. Bh for the 
pixel to be processed G22 is found by calculating 
the average of signals b21 and b23 after the white 
balance processing at two left and right pixels B21 
and B23 with the pixel to be processed G22 interposed 
therebetween (utilizing a correlation in the 
horizontal direction). Rh for the pixel to be 
processed G22 becomes slightly complicated. That 
is, gl2 which is a G signal at a pixel R12 is 
calculated as the average of gll and gl3 (i.e., 
utilizing a correlation in the horizontal 
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direction) . Rh is found from the ratio of gl2 found 
by the calculation to g22 actually obtained and rl2. 

The reason for this is that the ratio of the g 
signal and the r signal or the b signal is 
approximately equal between the adjacent pixels 
because local conversion of a chrominance signal is 
smaller than conversion of luminance. That is, r22 
{= Rh) is found, assuming that gl2 : rl2 = g22 : r22. 

When the block to be processed is an odd- 
numbered block in the odd field, Gv, Bv, and Rv for 
the center pixel G22 are calculated in the following 
manner in the vertical interpolation circuit 25. 

That is, the signal g22 after the white balance 
processing at the pixel to be processed G22 is used 
as Gv for the pixel to be processed G22. Rv for the 
pixel to be processed G22 is found by calculating 
the average of signals rl2 and r32 after the white 
balance processing at two upper and lower pixels R12 
and R32 with the pixel to be processed G22 interposed 
therebetween (utilizing a correlation in the 
vertical direction) . Bv for the pixel to be 
processed G22 is found, similarly to Rh, described 
above. That is, g21 which is a G signal at a pixel 
B21 is calculated as the average of gll and g31 
(utilizing a correlation in the vertical direction) , 
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Bv is calculated from the ratio of g21 to g22 found 
by the calculation and b21. 

When the block to be processed is an even- 
numbered block in the odd field, Gh, Bh, and Rh for 
a center pixel B22 are calculated in the following 
manner in the horizontal interpolation circuit 24. 

That is, a signal b22 after the white balance 
processing at the pixel to be processed B22 is used 
as Bh for the pixel to be processed B22. Gh for the 
pixel to be processed B22 is found by calculating 
the average of g21 and g23. With respect to Rh for 
the pixel to be processed B22, the average of rll 
and rl3 is first found to obtain rl2. Rh is found 
by the ratio of Gh (= g22) to gl2 and rl2. 

When the block to be processed is an even- 
numbered block in the odd field, Gv, Bv, and Rv for 
the center pixel B22 are calculated in the following 
manner in the vertical interpolation circuit 25. 

That is, the signal b22 is used as Bv for the 
pixel to be processed B22. Gv for the pixel to be 
processed B22 is found by calculating the average 
of gl2 and g32. With respect to Rv for the pixel 
to be processed B22, the average of rll and r31 is 
first found to obtain r21. Rv is found by the ratio 
of Gh (= g22) to g21 and r21. 
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Even when the block to be processed is a block 
in the even field, the same processing as the 
processing shown in Fig. 6 is performed, thereby 
making it possible to obtain signals Rh , Gh, Bh, Rv , 
Gv, and Bv. That is, when the block to be processed 
is an odd-numbered block in the even field, an 
arrangement of pixels composing the block is 
obtained by replacing R and B in a pixel arrangement 
in a case where the block to be processed is an 
e V e n - n la mb e r e d block in the odd field, as apparent 
from Figs. 5 (c) and 5 (d). In an operation 
expression used when the block to be processed is 
an e V e n - n u mb e r e d block in the odd field, therefore, 
r and b may be replaced with each other. 

When the block to be processed is an even- 
numbered block in the even field, an arrangement of 
pixels composing the block is obtained by replacing 
R and B in a pixel arrangement in a case where the 
block to be processed is an odd-numbered block in 
the odd field, as apparent from Figs. 5 (b) and 5 
(e) . In an operation expression used when the block 
to be processed is an odd-numbered block in the odd 
field, therefore, r and b may be replaced with each 
other . 

[A-2-3] Description of a horizontal direction 
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correlated value calculation circuit 28 and a 
vertical direction correlated value calculation 
circuit 29 

Each of the horizontal direction correlated 
value calculation circuit 28 and the vertical 
direction correlated value calculation circuit 29 
is basically constituted by a digital processing 
circuit composed of a block as shown in Fig. 4. 
Reference numerals 30 and 31 shown in Fig. 4 denote 
delay means comprising delay time equal to time 
required for one pixel to be transmitted, and 
reference numeral 32 denotes operation means. 

That is, the signals LO', LI', and L2' 
corresponding to different lines in the CCD 1 are 
inputted to the delay means 30 and 31, whereby 
signals corresponding to nine pixels are 
simultaneously fed to the operation means 32. 
Correlated value calculation processing is 
performed by an operation in the operation means 32. 

Fig. 7 illustrates an operation expression used 
by the horizontal direction correlated value 
calculation circuit 28 and the vertical direction 
correlated value calculation circuit 29. 

Specifically, the c o r r e 1 a t e d v a 1 u e calculation 
circuits 28 and 29 respectively calculate the 
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correlated values Sh and Sv using signals dn to daa 
after the white balance processing at all pixels Dii 
to D33 in a block composed of 3 by 3 pixels 
(corresponding to a block composed of M pixels by 
N pixels in the claims) . The operation expression 
used by the horizontal direction correlated value 
calculation circuit 28 is the same irrespective of 
the pattern of the pixels composing the block to be 
processed. Similarly, the operation expression used 
by the vertical direction correlated value 
calculation circuit 29 is the same irrespective of 
the pattern of the pixels composing the block to be 
processed . 

The smaller the horizontal direction 
correlated value Sv is, the stronger the correlation 
in the horizontal direction is. Similarly, the 
smaller the vertical direction correlated value Sv 
is, the stronger the correlation in the vertical 
direction is. 

[A-2-4] Description of the factor calculation 
means 26 

The factor calculation means 25 calculates the 
factors Kh and Kv in the horizontal direction and 
the vertical direction from the outputs Sh and Sv 
of the correlated value calculation means 23. 
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The factors Kh and Kv are found by the following 
expression (1) . A relationship of Kh + Kv = 1 holds 
between Kh and Kv . 

Kh = Sv/{Sh + Sv) 

Kv = Sh/iSh + Sv) "' 

Consequently, the factor Kh in the horizontal 
direction becomes large when a correlation in the 
horizontal direction is stronger than a correlation 
in the vertical direction (when Sh is smaller than 
Sv) . The factor Kv in the vertical direction becomes 
large when the correlation in the vertical direction 
is stronger than the correlation in the horizontal 
direction (when Sv is smaller than Sh). 

As described in the foregoing, signal 
components of R, G, and B signals corresponding to 
one pixel in the CCD are calculated utilizing outputs 
from pixels (nine pixels in all) around the one 
pixel. At this time, however, an operation is 
executed using a processing method suitable for a 
case where there is a strong correlation in the 
horizontal direction and a processing method 
suitable for a case where there is a strong 
correlation in the vertical direction. The results 
of the operation by the two methods are weighted and 
added depending on which of the horizontal 
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correlation and the vertical correlation in the 
vicinity of the pixel is stronger. 

[A-3] Description of Second Embodiment 

Description is made of an embodiment in a case 
where used as a gain control circuit for each color 
filter for enhancing the correlated value 
calculation precision is one for carrying out gain 
control for each filter by screen, and used as a CCD 
is a CCD for independently reading out all pixels. 

Fig. 8 illustrates the configuration of the CCD 
and a color separation circuit. In Fig. 8, 
components corresponding to those shown in Fig. 1 
are assigned the same reference numerals. 

The CCD 1 is a CCD for independently reading out 
all lines. Accordingly, only one horizontal 
transfer unit 7 is provided. Correspondingly, there 
are provided only respective one CDS 10, AGC 12, and 
A/D conversion circuit 14. 

A signal LO outputted from the A/D conversion 
circuit 14 is fed to a multiplier 101, and is fed 
to a first IH delay circuit 16. An output signal 
LI of the first IH delay circuit 16 (a signal which 
is delayed by one line from LO) is fed to a multiplier 
102, and is fed to a second IH delay circuit 17. An 
output signal L2 of the second IH delay circuit 17 



(a signal which is delayed by two lines from LO) is 
fed to a multiplier 103. That is, signals 
corresponding to three lines are respectively fed 
to multipliers 101, 102, and 103. 

That is, when a signal on the third line is 
inputted as LO in each frame, LI corresponds to the 
second line, and L2 corresponds to the first line. 
Then, LO corresponds to the fourth line, LI 
corresponds to the third line, and L2 corresponds 
to the second line. In the present embodiment, all 
signals are read out for each frame, so that odd 
fields and even fields are not distinguished. 

When the signal L2 (or LO) is a signal on an odd 
line and corresponding to an odd-numbered pixel on 
the line, therefore, an arrangement of pixels in a 
block to be processed composed of 3 by 3 pixels is 
as shown in Fig. 5 (b) . Further, when the signal 
L2 (or LO) is a signal on an odd line and 
corresponding to an e v e n — n umb e r e d pixel on the line, 
an arrangement of pixels in the block to be processed 
composed of 3 by 3 pixels is as shown in Fig. 5 (c) . 

When the signal L2 (or LO) is a signal on an even 
line and corresponding to an odd-numbered pixel on 
the line, therefore, an arrangement of pixels in the 
block to be processed composed of 3 by 3 pixels is 
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as shown in Fig. 5 (d) . Further, when the signal 
L2 (or LO) is a signal on an even line and 
corresponding to an e v e n - n u mb e r e d pixel on the line, 
an arrangement of pixels in the block to be processed 
composed of 3 by 3 pixels is as shown in Fig. 5 (e) . 

Furthermore, an RGB integration circuit 104 in 
a gain control circuit (a white balance processing 
circuit) for carrying out gain control for each color 
filter by screen calculates an integrated value for 
each of R, G, and B signals for each frame on the 
basis of the signal LI. The integrated value for 
each of the R, G, and B signals which is calculated 
by the RGB integration circuit 104 is fed to a 
microcomputer 105. 

The microcomputer 105 calculates gains 
respectively corresponding to the R, G, and B signals 
and outputs the calculated gains for each frame, on 
the basis of the integrated value for each of the 
R, G, and B signals corresponding to one frame which 
is fed from the RGB integration circuit 104, such 
that the integrated value for each of the R, G, and 
B signals is a constant value. 

Furthermore, the operations of the selection 
circuits 106 and 107 are the same as the operations 
of the selection circuits 106 and 107 in the first 

5 7 



embodiment except that an odd line/even line 
identification signal for j u d g i n g w h e t h e r the signal 
L2 (or LO) is a signal corresponding to an odd- 
numbered line or a signal corresponding to an 
e V e n - n u mb e r e d line in place of inputting a field 
identification signal as a control signal to a 
selection circuit 108. 

When the odd line/even line identification 
signal indicates that the signal is a signal 
corresponding to an odd-numbered line, the operation 
of the selection circuit 108 is the same as the 
operation in a case where the field identification 
signal indicates that the signal is a signal 
corresponding to an odd field in the first 
embodiment. When the odd line/even line 
identification signal indicates that the signal is 
a signal corresponding to an e v e n - n u mb e r e d line, the 
operation of the selection circuit 108 is the same 
as the operation in a case where the field 
identification signal is an even field in the first 
embodiment . 

Also in the present embodiment, examples of the 
type of block processed by a horizontal 
interpolation circuit 24 and a vertical 
interpolation circuit 25 are four types (Figs. 5(b) 
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to 5(e)), as in the first embodiment, and the 
contents of processing corresponding to the block 
of each of the types are the same as those in the 
first embodiment. The contents of processing by a 
horizontal direction correlated value calculation 
circuit 28 and a vertical direction correlated value 
calculation circuit 29 are the same as the contents 
of processing by the horizontal direction correlated 
value calculation circuit 28 and the vertical 
direction correlated value calculation circuit 29 
in the first embodiment. 

[A-4] Description of Third Embodiment 
Description is made of an embodiment in a case 
where used as a gain control circuit for each color 
filter for enhancing the correlated value 
calculation precision is one for dividing a screen 
into a plurality of areas and carrying out gain 
control for each color filter by areas, and used as 
a CCD is a CCD for simultaneously reading out two 
lines . 

Fig. 9 illustrates the configuration of the CCD 
and a color separation circuit. 

In Fig. 9, components corresponding to those 
shown in Fig. 1 are assigned the same reference 
numerals . 
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The third embodiment differs from the first 
embodiment in that a screen is divided into a 
plurality of areas, to carry out gain control for 
each color filter by areas, as shown in Fig. 10, in 
the third embodiment. 

In the third embodiment, gain control for each 
color filter is carried out not by screen but by areas 
obtained by dividing a screen. Accordingly, a signal 
inputted to interpolation means 22 cannot be 
ectly subjected to gain control. 

Each of signals LO, LI, and L2 outputted from 
election circuit 18 is divided into two parts. 

of the parts is inputted to the interpolation 
ns 22 as it is, and the other part is inputted 
correlated value calculation means 23 through 
tipliers 101, 102, and 103. White balance 
cessing is performed in a stage succeeding the 
or separation circuit. 

Description is now made of gain control for each 
or filter which is carried out in a stage 
ceding the correlated value calculation means 23 . 

As shown in Fig. 10, M by N integrated value 
culation areas Zii and Zkm are set in an effective 
ge region E in one field. 

A by-area RGB integrated value calculation 
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circuit 104 calculates an integrated value for each 
of R, G, and B signals for each of the integrated 
value calculation areas Zn and Znm by frame. The 
integrated value for each of the R, G, and B signals 
for each of the integrated value calculation areas 
Zii to Znm which is calculated by the by-area RGB 
integrated value calculation circuit 104 is fed to 
a microcomputer 105. 

The microcomputer 105 calculates typical gain 
values respectively corresponding to the R, G, and 
B signals for each of the integrated value 
calculation areas Zn to Znm by field, and outputs 
the calculated typical gain values to a pixel-unit 
RGB gain calculation circuit 109, on the basis of 
the integrated value for each of the R, G, and B 
signals for each of the integrated value calculation 
areas Zn to Znm which is fed from the by-area RGB 
integrated value calculation circuit 104, such that 
the integrated value for each of the R, G, and B 
signals is a constant value for each of the 
integrated value calculation areas Zn to Znm- 

The pixel-unit RGB gain calculation circuit 109 
calculates R, G, and B gains for a pixel 
corresponding to the signal LI outputted from the 
selection circuit 18 and outputs the calculated 
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gains to the selection circuits 106 and 107 on the 
basis of the typical gain values respectively- 
corresponding to the R, G, and B signals for each 
of the integrated value calculation areas Zn to Znm- 

Description is made of a method of calculating 
the R, G, and B gains for the pixel corresponding 
to the signal Ll outputted from the selection circuit 
18 using Fig. 11. 

All a method of calculating the R gain for the 
pixel corresponding to the signal Ll, a method of 
calculating the G gain for the pixel corresponding 
to the signal Ll, and a method of calculating the 
B gain for the pixel corresponding to the signal Ll 
are the same. Accordingly, the method of calculating 
the R gain for the pixel corresponding to the signal 
Ll will be described. 

In Fig. 11, only the four integrated value 
calculation areas Zn, Z12, Z21, and Z22 are 
illustrated for convenience of illustration. The 
typical R gain value calculated with respect to the 
area Zii is taken as an R gain for the pixel A at the 
center of the area Zn, which shall be denoted by a. 
Similarly, the typical R gain value calculated with 
respect to the area Z12 is taken as an R gain for the 
pixel B at the center of the area Z12, which shall 
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be denoted by b. Similarly, the typical R gain value 
calculated with respect to the area Z21 is taken as 
an R gain for the pixel C at the center of the area 
Z21, which shall be denoted by c. Similarly, the 
typical R gain value calculated with respect to the 
area Z22 is taken as an R gain for the pixel D at the 
center of the area Z22, which is denoted by d. 

The R gains for the pixels A, B, C, and D at the 
centers of the areas are a, b, c, and d. Description 
is made of a method of finding the R gain in a case 
where the pixel corresponding to the signal Ll is 
the pixel other than the pixels A, B, C, and D at 
the centers of the areas. 

It is assumed that the pixel corresponding to 
the signal Ll is a pixel P at a position spaced x 
apart rightward from the pixel A and spaced y apart 
downward therefrom in the area Zn, for example. The 
R gain p for the pixel P is found by linearly 
interpolating the R gains (a, b, c, d) for the 
respective center pixels in the four areas Zii, Z12, 
Z21, and Z22 around the pixel P. That is, the R gain 
for the pixel P is found by the following expression 
( 2 ) : 




x(m-x) ^ + 




( 2 ) 



m 
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The operations of the selection circuits 106, 
107, and 108 are the same as the operations of the 
units 106, 107, and 108 described in the first 
embodiment. Consequently, the signals LO, LI, and 
L2 are subjected to gain control for each color 
filter on the basis of the R gain, the G gain, and 
B gain for the pixel corresponding to the signal LO. 

The contents of processing by a horizontal 
direction correlated value calculation circuit 28 
and a vertical direction correlated value 
calculation circuit 29 are the same as the contents 
of processing by the horizontal direction correlated 
value calculation circuit 28 and the vertical 
direction correlated value calculation circuit 29 
in the first embodiment. 

The third embodiment differs from the first 
embodiment in that the signals inputted to a 
horizontal interpolation circuit 24 and a vertical 
interpolation circuit 25 are not signals LO', LI', 
and L2' which have been subjected to white balance 
processing on the entire screen but the signals LO, 
LI, and L2 outputted from the selection circuit 18. 
However, a method of processing the horizontal 
interpolation circuit 24 and the vertical 
interpolation circuit 25 is the same as the method 
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of processing the horizontal interpolation circuit 
24 and the vertical interpolation circuit 25 in the 
first embodiment. 

[A-5] Description of Fourth Embodiment 
Description is made of an embodiment in a case 
where used as a gain control circuit for each color 
filter for enhancing the correlated value 
calculation precision is one for dividing a screen 
into a plurality of areas and carrying out gain 
control for each color filter by areas, and used as 
a CCD is a CCD for independently reading out all 
pixels . 

Fig. 12 illustrates the configuration of the 
CCD and a color separation circuit. In Fig. 12, 
components corresponding to those shown in Fig. 1 
are assigned the same reference numerals. 

The CCD 1 is a CCD for independently reading out 
all lines. Accordingly, only one horizontal 
transfer unit 7 is provided. Correspondingly, there 
are provided only respective one CDS 10, AGC 12, and 
A/D conversion circuit 14. 

A signal LO is outputted from the A/D conversion 
circuit 14. A signal LI which is delayed by one line 
from LO is outputted from a first IH delay circuit 
16. A signal L2 which is delayed by two lines from 
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LO is outputted from a second IH delay circuit 17. 

In the fourth embodiment, gain control is 
carried out not by screen but by areas obtained by 
dividing a screen, as in the third embodiment. 
Accordingly, a signal inputted to interpolation 
means 22 cannot be subjected to gain control. 

Each of the signals LO, LI, and L2 outputted from 
the A/D conversion circuit 14, the first IH delay 
circuit 16, and the second IH delay circuit 17 is 
branched into two parts. One of the parts is inputted 
to the interpolation means 22 as it is, and the other 
part is inputted to the correlated value calculation 
means 23 through the multipliers 101, 102, and 103. 
White balance processing is performed in a stage 
succeeding the color separation circuit. 

In the fourth embodiment, one frame is divided 
into a plurality of integrated value calculation 
areas Zn and Znm, as shown in Fig. 10, and a by- 
area RGB integrated value calculation circuit 104 
calculates an integrated value for each of R, G, and 
B signals for each of the integrated value 
calculation areas Zu and Z^m. The integrated value 
for each of the R, G, and B signals for each of the 
integrated value calculation areas Zii and Znm which 
is calculated by the by-area RGB integrated value 



calculation circuit 104 is fed to a microcomputer 
10 5. 

The microcomputer 105 calculates typical gain 
values respectively corresponding to the R, G, and 
B signals for each of the integrated value 
calculation areas Zn to Znm by frame and outputs the 
calculated typical gain values to a pixel-unit RGB 
gain calculation circuit 109, on the basis of the 
integrated value for each of the R, G, and B signals 
for each of the integrated value calculation areas 
Zii to Znm which is fed from the by-area RGB integrated 
value calculation circuit 104, such that an 
integrated value for each of the R, G, and B signals 
is a constant value for each of the integrated value 
calculation areas Zii to Zkim- 

The pixel-unit RGB gain calculation circuit 109 
calculates R, G, and B gains for a pixel 
corresponding to the signal Ll outputted from the 
selection circuit 18 and outputs the calculated 
gains to the selection circuits 106 and 107 on the 
basis of the typical gain values respectively 
corresponding to the R, G, and B signals for each 
of the integrated value calculation areas Zn to Znm, 
in the same method as that in the third embodiment. 

The operations of the selection circuits 106, 



107, and 108 are the same as the operations of the 
selection circuits 105, 107, and 108 described in 
the second embodiment. Consequently, the signals 
LO, LI, and L2 are subjected to gain control for each 
color filter on the basis of the R gain, the G gain, 
and B gain for the pixel corresponding to the signal 
L 1 . 

The contents of processing by the horizontal 
direction correlated value calculation circuit 28 
and the vertical direction correlated value 
calculation circuit 29 are the same as the contents 
of processing by the horizontal direction correlated 
value calculation circuit 28 and the vertical 
direction correlated value calculation circuit 29 
in the first embodiment. 

The signals inputted to a horizontal 
interpolation circuit 24 and a vertical 
interpolation circuit 25 are not signals LO', Ll', 
and L2' which have been subjected to white balance 
processing but the signals LO, Ll, and L2 outputted 
from the selection circuit 18, as in the second 
embodiment. However, a method of processing by the 
horizontal interpolation circuit 24 and the vertical 
interpolation circuit 25 is the same as a method of 
processing the horizontal interpolation circuit 24 
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and the vertical interpolation circuit 25 in the 
second embodiment. 

[B] Description of Fifth Embodiment to Eighth 
Embodiment 

Fifth to eighth embodiments of the present 
invention will be described on the basis of Figs. 
14 to 3 1. 

[B-1] Description of Fifth Embodiment 

Fig. 14 illustrates the configuration of a CCD 
and a color separation circuit. 

The CCD 1 is provided with an imaging unit 2 and 
horizontal transfer units 7 and 8. An iris la serving 
as an f-stop for adjusting the amount of incidence 
of light on the imaging unit 2 is provided on a front 
surface of the CCD 1. 

Fig. 15 illustrates the configuration of the 
CCD 1 and its driving circuit. 

The imaging unit 2 is constituted by 
photodiodes 4 for performing photoelectric 
conversion and vertical transfer CCDs 5. Each of 
the photodiodes 4 comprises color filters in an 
arrangement, as indicated by R, G, and B. A vertical 
transfer CCD 5 is driven by a vertical driving 
circuit 6 outside the CCD 1. 

The horizontal transfer unit has a dual channel 



structure using the first horizontal transfer CCD 
7 and the second horizontal transfer CCD 8, so that 
signals corresponding to two lines are 
simultaneously obtained. The horizontal transfer 
CCDs 7 and 8 are driven by a horizontal driving 
circuit 9 outside the CCD 1. The present invention 
is not limited to the dual channel structure. For 
example, the horizontal transfer unit may have a 
single channel structure. 

Signals from the horizontal transfer units 7 
and 8 are respectively converted into digital 
signals by A/D conversion circuits 14 and 15 after 
being processed by CDSs (Correlation Double Sampling 
Circuits) 10 and 11 and AGC (Automatic Gain Control 
Circuits) 12 and 13. 

A signal DO outputted from the one A/D 
conversion circuit 14 is fed to a first selection 
circuit 19 in a selection circuit 18, and is fed to 
a first IH delay circuit 16. A signal Dl outputted 
from the other A/D conversion circuit 15 is fed to 
first and second selection circuits 19 and 20 in the 
selection circuit 18, and is fed to a second IH delay 
circuit 17. 

Each of the IH delay circuits 16 and 17 is a 
memory capable of storing an input signal 



corresponding to IH (one horizontal period) . A 
signal which is delayed by IH from the input signal 
is outputted from each of the IH delay circuits 16 
and 17. Signal writing and read-out to and from the 
IH delay circuit are performed in synchronization 
with horizontal transfer by the CCD 1. Therefore, 
a timing generation circuit 71 and a synchronizing 
signal generation circuit 70 for controlling the 
operation of the CCD 1 are synchronously operated. 

A timing pulse for driving the CCD 1, an odd 
pixel/even pixel identification signal, and a clock 
signal are outputted from the timing generation 
circuit 71. An HD (a horizontal synchronizing 
signal) , a VD (a vertical synchronizing signal) , and 
a field identification signal are outputted from the 
synchronizing signal generation circuit 70. The 
operation of another circuit portion is controlled 
by the signals outputted from the synchronizing 
signal generation circuit 70. 

An output 02 of the first IH delay circuit 16 
is fed to second and third selection circuits 20 and 
21 in the selection circuit 18. An output D3 of the 
second IH delay circuit 17 is fed to the third 
selection circuit 21 in the selection circuit 18. 
The selection circuit 18 selects digital 
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signals corresponding to three lines from digital 
signals corresponding to four lines depending on 
whether the type of field is an odd field or an even 
field, and outputs the selected digital signals. The 
selection circuits 19, 20, and 21 in the selection 
circuit 18 are controlled on the basis of the field 
identification signal representing the type of field 
outputted from the synchronizing signal generation 
circuit 70. 

That is, the signals Dl, D2, and D3 are selected 
in odd fields, and signals DO, Dl, andD2 are selected 
in even fields. More specifically, when the field 
identification signal indicates an odd field (for 
example, a low-level signal) , the first selection 
circuit 19 selects the signal Dl, the second 
selection circuit 20 selects the signal D2, and the 
third selection circuit 21 selects the signal D3. 
Conversely, when the field identification signal 
indicates an even field (for example, a high-level 
signal) , the first selection circuit 19 selects the 
signal DO, the second selection circuit 20 selects 
the signal Dl, and the third selection circuit 21 
selects the signal D2. In this way, signals LO, Ll, 
and L2 corresponding to three lines, which 
corresponds to the even and odd fields, are outputted 
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from the selection circuit 18. 

Fig. 16 illustrates the operation of the 
selection circuit 18. 

(a) shown in Fig. 16 indicates the horizontal 
synchronizing signal (HD) in the odd field. (f) 
indicates the field identification signal, which is 
at a low level because it is in the odd field. 

(b) to (e) shown in Fig. 16 respectively 
indicate the input signals D3, D2, Dl, and DO to the 
selection circuit 18 in the odd fields. When a field 
including an input image is the odd field, the 
signals D3, D2, and Dl are outputted from the 
selection circuit 18 as the signals L2, Ll, and LO. 

In the odd field, when a signal on the fourth 
line is inputted as DO, D3 corresponds to the first 
line, D2 corresponds to the second line, Dl 
corresponds to the third line, and DO corresponds 
to the fourth line, so that the signals on the first 
line, second line, and third line are selected. 
Then, D3 corresponds to the third line, D2 
corresponds to the fourth line, Dl corresponds to 
the fifth line, and DO corresponds to the sixth line, 
so that the signals on the third line, fourth line, 
and fifth line are selected. 

(g) shown in Fig. 16 indicates the horizontal 
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synchronizing signal (HD) in the even field. (1) 
indicates the field identification signal, which is 
at a high level because it is in the even field. 

(h) to (k) shown in Fig. 16 respectively 
indicate the input signals D3, D2, Dl, and DO to the 
selection circuit 18 in the even field. When a field 
including an input image is the even field, the 
signals D2, Dl, and DO are outputted from the 
selection circuit 18 as the signals L2, LI, and LO. 

In the even field, when a signal on the fourth 
line is inputted as DO, D3 corresponds to the first 
line, 02 corresponds to the second line, Dl 
corresponds to the third line, and DO corresponds 
to the fourth line, so that the signals on the second 
line, the third line, and the fourth line are 
selected. Then, D3 corresponds to the third line, 
D2 corresponds to the fourth line, Dl corresponds 
to the fifth line, and DO corresponds to the sixth 
line, so that the signals on the fourth line, the 
fifth line, and the sixth line are selected. 

The outputs LO, LI, and L2 of the selection 
circuit 18 are respectively fed to interpolation 
processing means 22 and correlation detection means 
2 3 . 

The interpolation processing means 22 is 



provided with a primary color correlated color 
separator 24 for performing interpolation 
processing utilizing a correlation of the ratio of 
colors in the horizontal direction or the vertical 
direction and a color difference correlated color 
separator 25 for performing Interpol, a tion 
processing utilizing a correlation of the difference 
between colors in the horizontal direction or the 
vertical direction. 

The correlation detection means 23 is provided 
with horizontal direction correlation detection 
means 23a and vertical direction correlation 
detection means 23b. A horizontal direction 
correlated value Sh is outputted from the horizontal 
direction correlation detection means 23a, and a 
vertical direction correlated value Sv is outputted 
from the vertical direction correlation detection 
means 23b. The two outputs Sh and Sv are fed to factor 
calculation means 32. In the factor calculation 
means 32, a factor Kh in the horizontal direction 
and a factor Kv in the vertical direction are 
calculated on the basis of both the correlated values 
Sh and Sv. The details of a method of calculating 
the correlated values and the factors will be 
described later. 
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Fig. 17 illustrates the configuration of the 
primary color correlated color separator 24. 

The primary color correlated color separator 24 
comprises a p r i m a r y - c o 1 o r - c o r r e 1 a t i o n horizontal 
interpolation circuit 26, a p r i m a r y - c o 1 o r - 
correlation vertical interpolation circuit 27, and 
weighting and addition means 28. 

The p r i ma r y - c o 1 o r - c o r r e 1 a t i o n horizontal 
interpolation circuit 26 performs interpolation 
processing suitable for a case where there is strong 
correlation in the horizontal direction on the basis 
of an output signal from the CCD 1 corresponding to 
three lines, to output chrominance signals Gh, Rh , 
and Bh . The p r i m a r y - c o 1 o r - c o r r e 1 a t i o n vertical 
interpolation circuit 27 performs interpolation 
processing suitable for a case where there is a 
strong correlation in the vertical direction on the 
basis of an output signal from the CCD 1 
corresponding to three lines, to output chrominance 
signals Gv , Rv , and Bv. A specific interpolation 
method by each of the interpolation circuits 26 and 
27 in the primary color correlated color separator 
24 will be described later. 

The case where there is a strong correlation in 
the horizontal direction means a case where there 
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is a strong correlation in the horizontal direction, 
but there is little correlation in the vertical 
direction, as in a fine h o r i z o n t a 1 1 y - s t r i p e d image. 
On the other hand, the case where there is a strong 
correlation in the vertical direction means a case 
where there is a strong correlation in the vertical 
direction, but there is little correlation in the 
vertical direction, as in a fine v e r t i c a 1 1 y - s t r i p e d 
image . 

The chrominance signals Gh, Rh , and Bh and the 
chrominance signals Gv, Rv and Bv which are 
respectively outputted from the interpolation 
circuits 26 and 27 are fed to the weighting and 
addition means 28. The factor Kh in the horizontal 
direction and the factor Kv in the vertical direction 
which are outputted from the factor calculation 
means 32 are further fed to the weighting and 
addition means 28. The weighting and addition means 
28 multiplies the chrominance signals Gh, Rh , and 
Bh by the factor Kh, multiplies the chrominance 
signals Gv, Rv , and Bv by the factor Kv , then adds 
the respective results of the multiplication of the 
signals in the same colors (Gh and Gv, Rh and Rv , 
and Bh and Bv) by the factors, and outputs final 
chrominance signals Gl, Rl, and Bl. 
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Fig. 18 illustrates the configuration of the 
color difference correlated color separator 25. 

The color difference correlated color 
separator 25 comprises a c o 1 o r - d i f f e r e n c e - 
correlation horizontal interpolation circuit 29, a 
color-difference-correlation vertical 

interpolation circuit 30, and weighting and addition 
means 31. A specific interpolation method by each 
of the interpolation circuits 29 and 30 in the color 
difference correlated color separator 25 will be 
described later. 

The color difference correlated color 
separator 25 and the above-mentioned primary color 
correlated color separator 24 only differ in the 
interpolation processing methods in the color- 
differ e n c e - c o r r e 1 a t i o n horizontal interpolation 
circuit 29 and the c o 1 o r - d i f f e r e n c e - c o r r e 1 a t i o n 
vertical interpolation circuit 30. Chrominance 
signals G2, R2, and B2 are finally outputted from 
the weighting and addition means 31 in the color 
difference correlated color separator 25. 

A primary color correlated color separating 
method and a color difference correlated color 
separating method will be described. The primary 
color correlated color separating system will be 
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first described. Each of the p r i ra a r y - c o 1 o r - 
correlation horizontal interpolation circuit 26 and 
the p r i ma r y - c o 1 o r - c o r r e 1 a t i o n vertical 
interpolation circuit 27 is basically constituted 
by a digital processing circuit composed of a block 
as shown in Fig. 19. Reference numerals 33 and 34 
shown in Fig. 19 denote delay means comprising delay 
time equal to time required for one pixel to be 
transmitted, and reference numeral 35 denotes 
operation means. Each of the interpolation circuits 
26 and 27 generates chrominance signals in three 
colors corresponding to the position of one pixel 
at the center of a block composed of 3 by 3 pixels 
on the basis of signals corresponding to the nine 
pixels in the block in this example. 

That is, the signals LO, LI, and L2 outputted 
from the selection circuits 19, 20, and 21 are 
inputted to the delay means 33 and 34, whereby the 
signals corresponding to the nine pixels are 
simultaneously fed to the operation means 35. 
Interpolation processing is performed by the 
operation in the operation means 35. 

Fig. 20 illustrates the relationship between an 
arrangement of pixels on the CCD 1 and the selected 
pixels . 
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As described in the foregoing, at the time of 
odd fields, line signals Dl, D2, and D3 are first 
selected. Accordingly, a block composed of 3 by 3 
pixels which are subjected to odd-numbered 
processing is as shown in Fig. 20 (b) , and the pixels 
which are subjected to even-numbered processing are 
as shown in Fig. 20 (c). 

On the other hand, in even fields, line signals 
DO, Dl, and D2 are first selected. Accordingly, a 
block which is subjected to odd-numbered processing 
is as shown in Fig. 20 (d) , and a block which is 
subjected to e v e n - n u mb e r e d processing is as shown 
in Fig. 20 (e). 

Fig. 21 illustrates an operation expression 
used by the horizontal interpolation circuit 26 and 
the vertical interpolation circuit 27 when a block 
to be processed is an odd-numbered block or an 
e V e n - n u mb e r e d block in an odd field. 

When the block to be processed is an odd- 
numbered block in the odd field, Gh, Bh, and Rh for 
a center pixel (a pixel to be processed) G22 are 
calculated in the following manner in the horizontal 
interpolation circuit 26. 

That is, a signal G22 at the pixel to be 
processed G22 is used as it is as Gh for the pixel 
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to be processed G22. Bh for the pixel to be processed 
G22 is found by calculating the average of signals 
B21 and B23 at two left and right pixels B21 and B23 
with the pixel to be processed G22 interposed 
therebetween (utilizing a correlation in the 
horizontal direction) . Rh for the pixel to be 
processed G22 becomes slightly complicated. That 
is, G12 which is a G signal at a pixel R12 is 
calculated as the average of Gil and G13 (i.e., 
utilizing a correlation in the horizontal 
direction) . Rh is found from the ratio of G12 found 
by calculation to G22 actually obtained and R12. 

The reason for this is that the ratio of the G 
signal to the R signal or the B signal is 
approximately equal between the adjacent pixels 
because the local change of a chrominance signal is 
smaller than the change of luminance. That is, R22 
(= Rh) is found, assuming that G12 : R12 = G22 : R22. 

When the block to be processed is an odd- 
numbered block in the odd field, Gv, Bv, and Rv for 
the center pixel (the pixel to be processed) G22 are 
calculated in the following manner in the horizontal 
interpolation circuit 27. 

That is, the signal G22 for the pixel to be 
processed G22 is utilized as it is as Gv for the pixel 
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to be processed G22. Rv for the pixel to be processed 
G22 is found by calculating the average of the 
signals R12 and R32 at upper and lower pixels R12 
and R32 with the pixel to be processed G22 interposed 
therebetween {utilizing a correlation in the 
vertical direction) . Bv for the pixel to be 
processed G22 is found, similarly to Rh , described 
above. That is, G21 which is a G signal at the pixel 
B21 is calculated as the average of Gil and G31 
(utilizing a correlation in the vertical direction) . 
Bv is calculated from the ratio of G21 found by 
calculation to G22 and B21. 

When the block to be processed is an even- 
numbered block in the odd field, Gh, Bh, and Rh 
corresponding to a center pixel (a pixel to be 
processed) B22 are calculated in the following 
manner in the horizontal interpolation circuit 26. 

That is, the signal B22 at the pixel to be 
processed B22 is used as it is as Bh for the pixel 
to be processed B22. Gh for the pixel to be processed 
B22 is found by calculating the average of the 
signals G21 and G23. With respect to Rh for the pixel 
to be processed B22, the average of Rll and R13 is 
first found to obtain R12. Rh is found from the ratio 
of Gh (= G22) to G12 and R12. 
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When the block to be processed is an even- 
numbered block in the odd field, Gv, Bv, and Rv for 
the center pixel (the pixel to be processed) B22 are 
calculated in the following manner in the vertical 
interpolation circuit 27. 

That is, a signal B22 at the pixel to be 
processed B22 is used as it is with respect to Bv 
for the pixel to be processed B22. Gv for the pixel 
to be processed B22 is found by calculating the 
average of G12 and G32. With respect to Rv for the 
pixel to be processed B22, the average of Rll and 
R31 is first found to obtain R21. Rv is found from 
the ratio of Gh (= G22) to G21 and R21. 

Even when the block to be processed is a block 
in the even field, the same processing as the 
processing shown in Fig. 21 is performed, thereby- 
making it possible to obtain signals Rh , Gh, Bh, Rv , 
Gv , and Bv. That is, when the block to be processed 
is an odd-numbered block in the even field, an 
arrangement of pixels composing the block is 
obtained by replacing R and B in a pixel arrangement 
in a case where the block to be processed is an 
even-numbered block in the odd field, as apparent 
from Figs. 20 (c) and 20 (d) . In an operation 
expression used when the block to be processed is 
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an e V e n - n umb e r e d block in the odd field, R and B may- 
be replaced with each other. 

When the block to be processed is an even- 
numbered block in the even field, an arrangement of 
pixels composing the block is obtained by replacing 
R and B in a pixel arrangement in a case where the 
block to be processed is an odd-numbered block in 
the odd field, as apparent from Figs. 20 (b) and 20 
(e) . In an operation expression used when the block 
to be processed is an odd-numbered block in the odd 
field, therefore, R and B may be replaced with each 
other . 

Each of the horizontal direction correlation 
detection circuit 23a and the vertical direction 
correlation detection circuit 23b is basically 
constituted by a digital processing circuit composed 
of a block as shown in Fig. 19. Reference numerals 
33 and 34 shown in Fig. 19 denote delay means 
comprising delay time equal to time required for one 
pixel to be transmitted, and reference numeral 35 
denotes operation means. 

That is, the signals LO, Ll, and L2 outputted 
from the selection circuits 19, 20, and 21 are 
inputted to the delay means 33 and 34, whereby 
signals corresponding to nine pixels are 
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simultaneously fed to the operation means 35. 
Correlated value detection processing is performed 
by an operation in the operation means 35. 

Fig. 22 illustrates an operation expression 
used by the horizontal direction correlation 
detection circuit 23a and the vertical direction 
correlation detection circuit 23b. 

The correlated value detection circuits 23a and 
23b respectively calculate the correlated values Sh 
and Sv utilizing G signals whose number is the 
largest in the block composed of 3 by 3 pixels. When 
the block to be processed is an odd-numbered block 
in the odd field, the vertical direction correlated 
value Sv is found by calculating the absolute value 
of the difference between G12 and G32. Since G12 
and G13 do not actually exist, G12 is calculated from 
Gil and G13, and G32 is calculated from G31 and G33. 

The horizontal direction correlated value Sh in 
a case where the block to be processed is an 
odd-numbered block in the odd field is found by 
calculating the absolute value of the difference 
between G21 and G23. Since G21 and G23 do not actually 
exist, G21 is calculated from Gil and G31, and G23 
is calculated from G13 and G33. 

When the block to be processed is an even- 

8 5 



numbered block in the odd field, the vertical 
direction correlated value Sv is found by 
calculating the absolute value of the difference 
between G12 and G32. The horizontal direction 
correlated value Sh is found by calculating the 
absolute value of the difference between G21 and G23. 

Even when the block to be processed is a block 
in the even field, the pattern of the G signal is 
the same, whereby the same processing may be 
performed. However, the operation expression in a 
case where the block to be processed is an odd- 
numbered block in the odd field and the operation 
expression in a case where the block to be processed 
is an e v e n - n u mb e r e d block in the even field are the 
same. The operation expression in a case where the 
block to be processed is an e v e n - n u m b e r e d block in 
the odd field and the operation expression in a case 
where the block to be processed is an odd-numbered 
block in the even field are the same. 

The smaller the horizontal direction 
correlated value Sh is, the stronger the correlation 
in the horizontal direction is. Similarly, the 
smaller the vertical direction correlated value Sv 
is, the stronger the correlation in the vertical 
direction is. 
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The factor calculation means 32 calculates 
factors Kh and Kv in the horizontal direction and 
the vertical direction from the correlated values 
Sh and Sv which are respectively calculated by the 
correlated value detection circuits 23a and 23b. 
Each of the factors Kh and Kv is found by the 
following expression (3) . A relationship of Kh + 
Kv = 1 holds between Kh and Kv . 

Kh = Sv/iSh + Sv) 

Kv = Sh/(Sh + Sv) "' 

Consequently, the factor Kh in the horizontal 
direction becomes large when the correlation in the 
horizontal direction is smaller than the correlation 
in the vertical direction (Sh is smaller than Sv) . 
The factor Kv in the vertical direction becomes large 
when the correlation in the vertical direction is 
smaller than the correlation in the horizontal 
direction (when Sv is smaller than Sh) . 

As described in the foregoing, the signal 
components of R, G, and B signals corresponding to 
one pixel in the CCD are calculated utilizing outputs 
from pixels (nine pixels in all) around the one 
pixel. At this time, however, an operation is 
executed using two methods, that is, a processing 
method suitable for a case where there is a strong 
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correlation in the horizontal direction and a 
processing method suitable for a case where there 
is a strong correlation in the vertical direction. 
The results of the operation by the two methods are 
weighted and added depending on which of the 
horizontal correlation and the vertical correlation 
in the vicinity of the pixel is stronger. 

The operation of the primary color correlated 
color separator 24 will be then described by taking 
a specific example. 

Consider a case where white incident light as 
shown in Fig. 23 (a) is incident on a block to be 
processed. In the example shown in Fig. 23 (a) , an 
example of an edge where there is no color component 
and only the luminance level is changed is 
illustrated. Consequently, all the levels of the 
signal components of the R, G, and B signals at a 
pixel to be processed (a center pixel) should be the 
same as a correct result. 

Fig. 23 (b) schematically illustrates the 
output level from each of the pixels. The reason 
why two types of output levels are illustrated differ 
in the color pattern, as described above, depending 
on the odd-numbered processing and the even-numbered 
processing. The signals Rh , Rv , Gh, Gv , Bh, and Bv 



at the pixel to be processed (center pixel), 
weighting factors Kh and Kv, and the signals R, 
and B < Ro , Go, and Bo) at the pixel to be processed 
(center pixel) obtained by adding the weighting 
factors, which are calculated in accordance with 
Figs. 21 and 22, are as shown in Figs. 23 (c) and 
23 (d) . The levels of the signal components of the 
R, G, and B signals at the central position are all 
equal to 0.2. 

The color difference correlated color 
separating system will be then described. 

The color difference correlated color 
separator 25 and the above-mentioned primary color 
correlated color separator 24 differ from each other 
in the following points. That is, the interpolation 
processing in the primary color correlated color 
separator 24 utilizes the property of the ratio of 
the G signal to the R signal or the B signal being 
approximately equal between adjacent pixels because 
the local change of a chrominance signal is smaller 
than the change in luminance and the property of the 
ratio of a 1 o w - f r e q u e n c y component to a high- 
frequency component of a particular color component 
being also equal in the other color component. 
Contrary to this, the interpolation processing in 



the color difference correlated color separator 25 
utilizes the property of the difference between the 
G signal and the R signal or the B signal being 
approximately equal between adjacent pixels because 
the local change of a chrominance signal is small 
and the property of the difference between a 
1 o w - f r e qu e n c y component and a high-frequency 
component of a particular color component being also 
equal in the other color component. 

Fig. 24 illustrates an operation expression 
used by the horizontal interpolation circuit 29 and 
the vertical interpolation circuit 30 in the color 
difference correlated color separator 25 when a 
block to be processed is an odd-numbered block or 
an even-numbered block in a odd field. 

When the block to be processed is an odd- 
numbered block in the odd field, Gh, Bh, and Rh for 
a center pixel (a pixel to be processed) G22 are 
calculated in the following manner in the horizontal 
interpolation circuit 29. 

That is, a signal G22 at the pixel to be 
processed G22 is used as it is as Gh for the pixel 
to be processed G22. Bh for the pixel to be processed 
G22 is found by calculating the average of signals 
B21 and B23 at the two left and right pixels B21 and 
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B23 with the pixel to be processed G22 interposed 
therebetween. With respect to Rh for the pixel to 
be processed G22, the property of the difference 
between the G signal and the R signal or the B signal 
being approximately equal between the adjacent 
pixels is utilized. That is, the following 
expression (4) holds: 

R22 - G22 = /ei2 - G12 = R32 - G32 

= {(/?12-G12)/2} + {(i?32-G32)/2} "' 

Consequently, Rh (= R22) for the pixel to be 
processed G22 is found by the following expression 
(5) : 

Rh = { (R12 - G12) / 2} + { (/?32 - G32) / 2} + G22 

= {(i?12 + i?32)/2}-{(G12 + G32)/2} + G22 -•• (5) 

= {(i?12 + i?32)/2}-((Gll + G13 + G31 + G33)/4} + G22 

Even when the block to be processed is an 
even-numbered block in the odd field, the horizontal 
interpolation circuit 29 performs the same 
operation, to find Gh, Rh , and Bh. 

Furthermore, a method of finding Gv, Rv , and Bv 
in the vertical interpolation circuit 30 is 
basically the same as that in interpolation 
processing by the horizontal interpolation circuit 
29 and hence, the description thereof is not 
repeated . 

In an operation expression shown in Fig. 21, 



operation processing is occupied by multiplication 
and division. In an operation expression shown in 
Fig. 24, multiplication and division are replaced 
with addition and subtraction, and division for 
making a circuit arrangement particularly 
complicated is not used, thereby making it possible 
to significantly simplify the configuration of an 
operation processing circuit. 

According to the interpolation processing by a 
color difference correlated color separating 
system, the number of false chrominance signals is 
small with respect to an image close to a monotone 
image, thereby obtaining an image of high quality. 

The chrominance signals Gl, Rl, Bl, G2, R2, and 
B2 outputted from the color separators 24 and 25, 
described above, are fed to a weighting and addition 
circuit 36 serving as synthesis means. The weighting 
and addition means 36 outputs final chrominance 
signals GO, RO, and BO. 

The chrominance signals GO, RO, and BO 
outputted from the weighting and addition circuit 
36 are fed to an AGC control circuit 37. The AGC 
control circuit 37 adjusts the degree of an aperture 
of an iris la from the chrominance signals GO, RO, 
and BO or the gains of the AGCs 12 and 13 in order 
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to control the luminance level of an image picked 
up. Specifically, the iris la is basically- 
controlled, to issue an instruction to reduce the 
gains of the AGCs when the aperture of the iris la 
increases to a maximum. At this time, an instruction 
to control the gains of the AGCs 12 and 13 is also 
fed to the weighting and addition circuit 36. 

The weighting and addition circuit 36 is so 
operated as to weight the chrominance signals Gl, 
Rl, and Bl from the primary color correlated color 
separator 24, weight the chrominance signals G2, R2, 
and B2 from the color difference correlated color 
separator 25, and add the weighted chrominance 
signals depending on the gains of the AGCs 12 and 
13. Specifically, the chrominance signals are added 
such that the chrominance signals Gl, Rl, and Bl are 
larger than the chrominance signals G2, R2, and B2 
if the gains of the AGCs 12 and 13 are small, while 
being added such that the chrominance signals G2, 
R2 , and B2 are larger than the chrominance signals 
Gl, Rl, and Bl if the gains are large, so that the 
chrominance signals GO, RO, and BO are outputted. 

In Fig. 23, it is assumed that the detection of 
a correlation is erroneously detected due to the 
effect of noise or the like. Consequently, the 
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values of Go, Ro, and Bo are the values of Gh, Rh , 
and Bh. As a result, an error occurs with respect 
to a value (0.2) which should be inherently taken. 
The error is 0.133 in the o d d - n u mb e r e d R signal and 
0.4 in the o d d - n u mb e r e d B signal (an upper drawing 
in Fig. 23 (b) ) , and 0.4 in the even-numbered G signal 
and 1.6 in the e v e n - n u mb e r e d R signal (a lower 
drawing in Fig. 23 (b)) . The total sum of the errors 
is 2.533. 

On the other hand, in a case where interpolation 
is performed in the color difference correlated 
color separator 25, even when the direction of a 
correlation is erroneously detected, the sum of the 
errors is only 2.2, as shown in Fig. 25. This is 
an example. Since division is used in primary color 
correlation, however, the precision is degraded when 
the divisor (the denominator) approaches zero, so 
that the number of errors is increased. As a result, 
noise is increased. Particularly when it is dark, 
the probability that the divisor approaches zero is 
high, causing a problem. 

In the present embodiment, the chrominance 
signals are added such that the chrominance signals 
Gl, Rl , and Bl are larger than the chrominance 
signals G2, R2, and B2 if the gains of the AGCs 12 
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and 13 are small, while being added such that the 
chrominance signals G2, R2, and B2 are larger than 
the chrominance signals Gl, Rl, and Bl if the gains 
are large. Accordingly, it is possible to restrain 
the emphasis of noise included in an image produced 
by primary color correlated color separation 
processing and false colors included therein, and 
the resolution can be improved. 

Although in the above-mentioned embodiment, an 
output of the primary color correlated color 
separator 24 and an output of the color difference 
c'orrelated color separator 25 are weighted and added 
depending on the gains of the AGCs 12 and 13, the 
present invention is not limited to the same. For 
example, they may be weighted and added depending 
on the contrast of an image and the level of a signal. 

Although in the above-mentioned primary color 
correlated color separator 24 and the color 
difference correlated color separator 25, 
interpolation processing is performed in units of 
3 by 3 pixels, the present invention is not limited 
to the same. For example, if the interpolation 
processing is performed in units of 5 by 5 pixels, 
the false colors are further restrained, thereby 
making it possible to improve the resolution. 



Although in the present embodiment, description was 
made of a case where the present invention is applied 
to an interlace signal, the present invention is also 
applicable to a progressive signal. 

[B-2] Description of Sixth Embodiment 

The sixth embodiment differs from the fifth 
embodiment in terms of the operations of a 
primary-color-correlation horizontal 
interpolation circuit 26 and a p r ima r y - c o 1 o r - 
correlation vertical interpolation circuit 27 in a 
primary color correlated color separator 24. 
Further, the sixth embodiment differs from the fifth 
embodiment in terms of the operations of a 
color-difference-correlation horizontal 
interpolation circuit 29 and a c o 1 o r - d i f f e r e n c e - 
correlation vertical interpolation circuit 30 in a 
color difference correlated color separator 25. 

Each of interpolation circuits 26, 27, 29, and 
30 produces chrominance signals in three colors 
corresponding to one pixel (a pixel to be processed) 
at the center on the basis of signals at 25 pixels 
in a block composed of 5 by 5 pixels in the sixth 
embodiment . 

[B-2-1] Description of the interpolation 
circuits 26 and 27 in the primary color correlated 



color separator 24 

Description is now made of the operations of the 
primary-color-correlation horizontal 

interpolation circuit 26 and the p r i m a r y - c o 1 o r - 
correlation vertical interpolation circuit 27 in the 
primary color correlated color separator 24. The 
interpolation circuits 26 and 27 calculate 
chrominance signals R, G, and B at the pixel to be 
processed by a primary color correlated color 
separating system. 

Fig. 26 illustrates an operation expression 
used by the horizontal interpolation circuit 26 and 
the vertical interpolation circuit 27 in a case where 
the block to be processed is an odd-numbered block 
or an e v e n - n umb e r e d block in an odd field. 

The operation of the vertical interpolation 
circuit 27 in a case where the block to be processed 
is an odd-numbered block in the odd field is taken 
as an example, to describe the primary color 
correlated color separating system. 

In the primary color correlated color 
separating system, the direction in which the 
correlation of an image is strong in a local area 
is detected, to first calculate two 1 o w - f r e q u e n c y 
chrominance signals on the same line by filtering 



by lines in only the direction in which there is a 
strong correlation (here, the vertical direction or 
the horizontal direction) . 

In the vertical interpolation circuit 27, it is 
assumed that there is a strong correlation in the 
vertical direction at the pixel to be processed in 
the block composed of 5 by 5 pixels in an upper part 
of Fig. 26, to calculate 1 o w - f r e q u e n c y chrominance 
signals Rvlpfs and Gvlpfs of the chrominance signals 
R and G from a vertical line including a pixel to 
be processed G33. 

In a signal which is gently changed, the ratio 
of chrominance signals at respective pixels and the 
ratio of their low-freguency chrominance signals are 
approximately equal. When there is a strong 
correlation in the vertical direction, therefore, 
Rv(=R33)/G33 = Rvlpfs/Gvi.pfs holds on the vertical line 
including the pixel to be processed G33. 
Consequently, another chrominance signal Rv 
existing on the vertical line including the pixel 
to be processed G33 can be found from the ratio of 
the two 1 o w - f r e qu en c y chrominance signals Rvlpf3 and 
GvLPF3 on the vertical line and a chrominance signal 
G33 at the pixel to be processed G33. 

As Gv for the pixel to be processed G33, the 
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siqnaJ GB3 at the pixel to be processed G33 is used 
as it is. 

Only the chrominance signals (R and G in this 
example) existing on a line to be an object (the 
vertical line in this example) can be color- 
separated from the respective one vertical and 
horizontal lines . A chrominance signal Bv which does 
not exist on the line to be an object is found from 
signals on the adjacent lines and the signal at the 
pixel to be processed utilizing a correlation 
between colors, that is, the property of "the change 
in the ratio of colors is small even in the direction 
in which a correlation between images is low (the 
horizontal direction in this example)", that is, 
Bv(=B33)/G33 = B32/G32 = B34/G34. 

Here, the horizontal direction is the direction 
in which the correlation is low. Accordingly, the 
ratios of the chrominance signals at both the 
adjacent pixels in the horizontal direction are 
averaged, thereby compensating for the low 
correlation, as shown in the expression (6): 

Bv [{(B32/G32) + (B34/G34)}/2 JxG33 ( e > 

The expression (6) may be replaced with an 
expression obtained by simplifying the expression 
(6), i.e., Bv = (B32/G32) X G33. In Fig. 26, an 
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expression obtained by expanding the simplified 
expression is described as Bv. 

It is desirable that filters for finding a 
1 o w - f r e qu e n c y component of a signal used herein 
respectively have frequency characteristics as 
close to each other as possible. In order to match 
the filter characteristics of signals which differ 
in sampling phase, the tap length of the filter must 
be significantly lengthened, thereby significantly 
increasing the circuit scale, which is not 
practical . 

By paying attention to the fact that a low- 
frequency chrominance signal component in the 
direction in which the correlation is high, low- 
frequency portions, having a frequency up to 
one-half of the Nyquist frequency, of the filters 
are attached importance to, to use the following 
expression (7) such that the respective frequency 
characteristics in the 1 o w - f r e q u e n c y portions are 
close to each other and the number of taps composing 
each of the filters can be reduced: 

= (G13 + 6 X G33 + G53) / 8 
R^^p^^ = (R23 + R43)/2 "' ^ ^ ^ 

Although description was made of the operation 
of the vertical interpolation circuit 27 in a case 
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where the block to be processed is an odd-numbered 
block in the odd field, Rv , Gv , and Bv at the pixel 
to be processed can be found by the same operation 
even in a case where the block to be processed is 
an even-numbered block in the odd field. 

In the horizontal interpolation circuit 26, it 
is assumed that there is a strong correlation in the 
horizontal direction, thereby making it possible to 
find Rh , Gh, and Bh at the pixel to be processed. 

Even when the block to be processed is in the 
even field, color separation can be made by the same 
method . 

In the primary color correlated color 
separating system, division for finding the ratio 
of chrominance signals is performed. When the 
divisor is close to zero, therefore, an error is 
increased. When the divisor is zero, an operation 
cannot be executed. Therefore, such exception 
processing that a constant is forced to be one in 
a case where the divisor is zero. When a screen is 
dark, and there is noise in a dark part of an image, 
therefore, the noise is emphasized, thereby 
producing dot noises. 

That is, the primary color correlated color 
separating system exhibits good characteristics 
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when the state of an input image is good, that is, 

input light is sufficient. 

[B-2-2] Description of the interpolation 

circuits 29 and 30 in the color difference correlated 

color separator 25 

Description is made of the operations of the 

color-difference-correlation horizontal 

interpolation circuit 29 and the color- 
differ e n c e - c o r r e 1 a t i o n vertical interpolation 
circuit 30 in the color difference correlated color 
separator 25. The interpolation circuits 29 and 30 
calculate chrominance signals R, G, and B at the 
pixel to be processed by a color difference 
correlated color separating system. 

Fig. 27 illustrates an operation expression 
used by the horizontal interpolation circuit 29 and 
the vertical interpolation circuit 3 0 in a case where 
the block to be processed is an odd-numbered block 
or an e v e n - n u mb e r e d block in an odd field. 

The operation of the vertical interpolation 
circuit 30 in a case where the block to be processed 
is an odd-numbered block in the odd field is taken 
as an example, to describe the color difference 
correlated color separating system. 

In the color difference correlated color 
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separating system, the direction in which a 
correlation of images is strong in a local area is 
detected utilizing a color difference correlation 
"the change in a color difference signal in a local 
area is small", to first calculate two low-frequency 
chrominance signals on the same line by filtering 
by lines in only the direction in which there is a 
strong correlation {here, the vertical direction or 
the horizontal direction) . 

In the vertical interpolation circuit 30, it is 
assumed that there is a strong correlation in the 
vertical direction at the pixel to be processed G33 
in the block composed of 5 by 5 pixels in an upper 
part of Fig. 27, to calculate 1 o w - f r e q u e n c y 
chrominance signals Rvlpfs and GvhBF3 of the 
chrominance signals R and G from a vertical line 
including the pixel to be processed G33. 

In a signal which is gently changed, the 
difference between chrominance signals at 
respective pixels and the difference between their 
1 o w - f r e qu en c y chrominance signals are 
approximately equal. When there is a strong 
correlation in the vertical direction, Rv(=R33) - 
G33 = RvLPF3 - GvLPFs holds on the vertical line 
including the pixel to be processed G33. 
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Consequently, another chrominance signal Rv 
existing on the vertical line including the pixel 
to be processed G33 can be found from the difference 
between the two 1 o w - f r e q u e n c y chrominance signals 
RvLPF3 and Gvlpf3 on the vertical line and a chrominance 
signal G33 at the pixel to be processed G33. 

As Gv for the pixel to be processed G33, the 
signal G33 at the pixel to be processed G33 is used 
Q a s i t i s . 

Only the chrominance signals (R and G in this 

ry 

CO example) existing on a line to be an object (the 

''■J, vertical line in this example) can be color- 

iL, separated from the respective one vertical and 

j'^^" horizontal lines. A chrominance signal Bv which does 

not exist on the line to be an object is found from 
^' signals on the adjacent lines and the signal at the 

pixel to be processed utilizing a correlation 
between colors, that is, the property of "the change 
in the difference in color is small even in the 
direction in which a correlation between images is 
low (the horizontal direction in this example)", 
that is, Bv(=B33)-G33 = B32-G32 = B34-G34. 

Here, the horizontal direction is the direction 
in which the correlation is low. Accordingly, the 
color difference signals at both the adjacent pixels 
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in the horizontal direction are averaged, as 
expressed by the following expression (8), thereby 
compensating for the low correlation. 

5v = [{(fi32-G32) + (fi34-G34)}/2] + G33 ••• (8) 

The expression (8) may be replaced with an 
expression obtained by simplifying the expression 
(8), i.e., Bv = (B32-G32) + G33. In Fig. 27, an 
expression obtained by expanding the simplified 
expression is described as Bv. 

Although description was made of the operation 
of the vertical interpolation circuit 30 in a case 
where the block to be processed is an odd-numbered 
block in the odd field, Rv , Gv, and Bv at the pixel 
to be processed can be found by the same operation 
even in a case where the block to be processed is 
an even-numbered block in the odd field. 

In the horizontal interpolation circuit 29, it 
is assumed that there is a strong correlation in the 
horizontal direction, thereby making it possible to 
find Rh , Gh, and Bh at the pixel to be processed. 

Even when the block to be processed is in the 
even field, color separation can be made by the same 
method . 

In the color difference correlated color 
separating system, chrominance signals can be found 
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only by addition and subtraction without performing 
division. Therefore, the system is characterized 
in that an error does not easily occur, and it also 
resists noise. 

As the gain of automatic gain control means of 
a camera is increased, more chrominance signals 
calculated by the color difference correlated color 
separating system which resists noise are utilized. 
When the gain of the automatic gain control means 
of the camera is small, more chrominance signals 
calculated by the primary color correlated color 
separating system are utilized. 

[B-3] Description of Seventh Embodiment 
The seventh embodiment differs from the fifth 
embodiment in terms of the operations of a 
primary-color-correlation horizontal 
interpolation circuit 26 and a p r i m a r y - c o 1 o r - 
correlation vertical interpolation circuit 27 in a 
primary color correlated color separator 24. 
Further, the seventh embodiment differs from the 
fifth embodiment in terms of the operations of a 
color-difference-correlation horizontal 
interpolation circuit 29 and a c o 1 o r - d i f f e r e n c e - 
correlation vertical interpolation circuit 30 in a 
color difference correlated color separator 25. 

10 6 



Each of the interpolation circuits 26, 27, 29 
and 30 produces chrominance signals in three colors 
corresponding to one pixel (a pixel to be processed) 
at the center on the basis of signals at 25 pixels 
in a block composed of 5 by 5 pixels in the seventh 
emb o d i m e n t . 

In the seventh embodiment, the color- 
differ e n c e - c o r r e 1 a t i o n horizontal interpolation 
circuit 29 and the c o 1 o r - d i f f e r e n c e - c o r r e 1 a t i o n 
vertical interpolation circuit 30 in the color 
difference correlated color separator 25 shown in 
Fig. 14 find chrominance signals R, G, and B at the 
pixel to be processed by a color difference 
correlated color separating system, as in the 
above-mentioned sixth embodiment. 

Furthermore, in the seventh embodiment, the 
primary color correlated color separator 24 shown 
in Fig. 14 is replaced with a color separator for 
finding chrominance signals R, G, and B at the pixel 
to be processed by an adaptive correlated color 
separating system (hereinafter referred to as an 
adaptive correlated color separator) in place of the 
primary color correlated color separator 24 shown 
in Fig. 14. The p r i m a r y - c o 1 o r - c o r r e 1 a t i o n 
horizontal interpolation circuit 26 and the 
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p r ima r y- c o 1 o r - c o r r e 1 a t i on vertical interpolation 
circuit 27 in the adaptive correlated color 
separator 24 find chrominance signals R, G, and B 
at the pixel to be processed by the adaptive 
correlated color separating system 24. 

Description is made of the operations of the 
primary-color-correlation horizontal 
interpolation circuit 26 and the p r i m a r y - c o 1 o r - 
correlation vertical interpolation circuit 27 in the 
adaptive correlated color separator 24. The 
interpolation circuits 26 and 27 calculate the 
chrominance signals R, G, and B at the pixel to be 
processed by the adaptive correlated color 
separating system. 

Fig. 28 illustrates an operation expression 
used by the p r i m a r y - c o 1 o r - c o r r e 1 a t i o n horizontal 
interpolation circuit 26 and the p r i m a r y - c o 1 o r - 
correlation vertical interpolation circuit 27 in the 
adaptive correlated color separator 24 in a case 
where the block to be processed is an odd-numbered 
block or an e v e n - n u mb e r e d block in an odd field. 

The operation of the vertical interpolation 
circuit 27 in a case where the block to be processed 
is an odd-numbered block in the odd field is taken 
as an example, to describe the adaptive correlated 
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color separating system. 

In the adaptive correlated color separating 
system, the direction in which the correlation of 
an image is strong in a local area is detected, to 
first calculate two 1 o w - f r e q u e n c y chrominance 
signals on the same line by filtering by lines in 
only the direction in which there is a strong 
correlation (here, the vertical direction or the 
horizontal direction) . 

In the vertical interpolation circuit 27, it is 
assumed that there is a strong correlation in the 
vertical direction at the pixel to be processed G33 
in the block composed of 5 by 5 pixels in an upper 
part of Fig. 28, to calculate 1 o w - f r e q u e n c y 
chrominance signals Rvlpf3 and Gvlpfs of the 
chrominance signals R and G from a vertical line 
including the pixel to be processed G33. 

In a signal which is gently changed, the 
difference between chrominance signals at 
respective pixels and the difference between their 
1 o w- f r e qu e n c y chrominance signals are 
approximately equal. When there is a strong 
correlation in the vertical direction, therefore, 
Rv( = R33)-G33 = RvLPF3-GvLPF3 holds on the vertical line 
including the pixel to be processed G33. 
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Consequently, another chrominance signal Rv 
existing on the vertical line including the pixel 
to be processed G33 can be found from the difference 
between the two 1 o w - f r e qu e n c y chrominance signals 
RvLPF3 and Gvlpfs on the vertical line and the 
chrominance signal G33 at the pixel to be processed. 
A method of finding Rv is the same as that in the 
color difference correlated color separating 
system. 

As Gv for the pixel to be processed G33, the 
signal G33 for the pixel to be processed G33 is used 
as it is. 

Only the chrominance signals (R and G in this 
example) existing on a line to be an object (the 
vertical line in this example) can be color- 
separated from the respective one vertical and 
horizontal lines. A chrominance signal Bv which does 
not exist on the line to be an object is found from 
signals on the adjacent lines and the signal at the 
pixel to be processed utilizing a correlation 
between colors, that is, the property of "the change 
in the ratio of colors is small even in the direction 
m which a correlation between images is low (the 
horizontal direction in this example)", that is, Bv 
{=B33)/G33 = B32/G32 = B34/G34. A method of finding 
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Bv is the same as that in the primary color correlated 
color separating system. 

Here, the horizontal direction is the direction 
in which the correlation is low. Accordingly, the 
color difference signals at both the adjacent pixels 
in the horizontal direction are averaged, as 
expressed by the following equation (9), thereby 
compensating for the low correlation. 

Bv = [{(B32/G32) + (B34/G34)}/2] x G33 ■- ( 9 ) 

The expression (9) may be replaced with an 
expression obtained by simplifying the expression 
(9), i.e., Bv = (B32/G32) X G33. In Fig. 28, an 
expression obtained by expanding the simplified 
expression is described as Bv. 

Although description was made of the operation 
of the vertical interpolation circuit 27 in a case 
where the block to be processed is an odd-numbered 
block in the odd field, Rv , Gv , and Bv at the pixel 
to be processed can be found by the same operation 
even in a case where the block to be processed is 
an even-numbered block in the odd field. 

In the horizontal interpolation circuit 26, it 
is assumed that there is a strong correlation in the 
horizontal direction, thereby making it possible to 
find Rh , Gh, and Bh at the pixel to be processed. 
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Even when the block to be processed is in the 
even field, color separation can be made by the same 
method . 

[B-4] Description of Modified Example of 
Correlation Detection Means 23 

Description is now made of a modified example 
of the correlation detection means 23. The modified 
example is, of course, applicable to the second or 
seventh embodiment. For example, it is also 
applicable in the fifth embodiment. 

Used as the horizontal direction correlation 
detection means 23a and the vertical direction 
correlation detection means 23b in the correlation 
detection means 23 may be ones for calculating a 
horizontal direction correlated value Sh and a 
vertical direction correlated value Sv in the 
following manner. 

The horizontal direction correlation detection 
means 23a and the vertical direction correlation 
detection means 23b respectively calculate 
correlated values Sh and Sv corresponding to one 
pixel (a pixel to be processed) at the center on the 
basis of signals at 25 pixels in a block composed 
of 5 by 5 pixels. 

[B-4-1] Description is first made of a method 



112 



of calculating the correlated values Sh and Sv in 
a case where a block to be processed is an odd- 
numbered block in an odd field, as shown in an upper 
part of Fig. 27 

In a case where the block to be processed is 
achromatic, the correlated values Sh and Sv are 
calculated on the basis of the following expression 
(10) : 



4 4 I 

|/?23 + 2xG33 + /?43 G24 + 2x534 + G44| 



I 4 4 

|G22 + 2x/?23 + G24 i?32 + 2xG33 + fi34| 



4 4 I 

|fi32 + 2xG33 + 534 G42 + 2 x i?43 + G44 1 



The foregoing expression (10) can be 
simplified, as expressed by the following expression 
(10)': 

Sh = | <^22 + 2x^32 + G42 G24 + 2x^34 + G44| 
I 4 4 I 

, _ I G22 + 2 x /g23 + G24 G42 + 2 x j?43 + G44 1 "' ' 

I 4 4 1 

If a horizontal direction correlated value is 
found after averaging signals in the vertical 
direction in a case where the horizontal direction 
correlated value Sh is calculated, and a vertical 
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direction correlated value is found after averaging 
signals in the horizontal direction in a case where 
the vertical direction correlated value Sv is 
calculated, as expressed in the following expression 
(11) , the precision is further improved: 

^ 1 512 + 2 X (G22 + 2 X 532 + G42) + 552 _ Gl 3 + 2 x (R23 + 2 x G33 + R43) + G53 1 
I 10 w I 

_^ |G13 + 2 X (R23 + 2 X G33 + R43) + G53 _ 514 + 2 x (G24 + 2 x 534 + G44) + G5 4 1 
I 10 I 

^ 1 52 1 + 2 x (G22 + 2 X 523 + G24) + 525 _ G31 + 2x(532 + 2xG33 + 534) + G 35| 

I 10 m I 

^ I G3 1 + 2 X (532 + 2 X G33 + 534) + G35 54 1 + 2 x (G42 + 2 x 543 + G44) + 545 1 

I 10 m 



••• (11) 

A dividing circuit may be able to be constituted 
by only a bit shift circuit by taking factors by which 
G33, B22, and B34 are respectively multiplexed as 
one in the foregoing expression (11) for calculating 
Sh and taking factors by which G33, R23, and R43 are 
respectively multiplexed as one in the expression 
for calculating Sv, to take the divisor in each of 
the expressions as eight which is the n-th power of 
2 . 

The foregoing expression (11) can be 
simplified, as expressed by the following expression 
(11) ' : 
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5/1 = 1^^^ + ^^^*^^^ + ^^^^^ + ^42) + 552 _ BU + 2X (G24 + 2 x 534 + G44) + G54 j 
I 10 10 I 

Sv = \^^^'^^^ ^^^^ + 2 X /?23 + G24) + R25 _ R4l + 2x (G42 + 2xR43 + G44) + /g45 1 



••• { 11 ) ' 

In a chromatic image, the ratios of the R, G, 
and B signals outputted from a CCD including color 
filters in a Mosaic arrangement differ depending on 
the color of a subject. Therefore, a disturbance 
is created depending on the color of the subject, 
so that the precision of the result of the judgment 
in the direction of a correlation using signals 
representing all pixels composing the CCD. 
Therefore, the intensity of the color of an input 
image is judged from the result of the integration 
of color difference signals in respective parts of 
a screen. In the chromatic image, the correlated 
values Sh and Sv are calculated on the basis of only 
the G signal. 

That is, when the block to be processed is a 
chromatic color, the correlated values Sh and Sv are 
calculated on the basis of the following expression 
(12): 
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(G22 + G42) (G13 + 2xG33 + G53) \ ^ \ (G13 + 2xG33 + G53) (G24 + G44) \ 



2 



^^,_\ (G22 + G24) (G3I + 2xG33 + G35) \ ^ \ (G31 + 2xG33 + G35) (G42 + G44) 



2 4 II 4 '2 

■■• (12) 

The foregoing expression (12) can be 
simplified, as expressed by the following expression 

(12) ' : 

Sh = K<^22 + G42) (G24 + G44) | 
12 2 1 

^^_| (G22 + G24) (G42 + G44) | "' 

I 2 2 1 

[B-4-2] Description is made of a method of 
calculating the correlated values Sh and Sv in a case 
where a block to be processed is an e v e n - n umb e r e d 
block in an odd field, as shown in a lower part of 
Fig. 2 7 

In a case where the block to be processed is 
achromatic, the correlated values Sh and Sv are 
calculated on the basis of the following expression 

(13) : 
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\R22 + 2xG32 + R42 G23 + 2x533 + G43| 



4 4 I 

|G23 + 2x533 + G43 /e24 + 2xG34 + /?44| 



I 4 4 

|i?22 + 2xG23 + /?24 G32 + 2x£33 + G34| 



4 4 I 

|G32 + 2xfi33 + G34 7?42 + 2xG43 + i?44| 



The foregoing expression (13) can be 
simplified, as expressed by the following expression 
(13 ) ' . 

Sh = | ^2^ + 2xG32 4-/g42 _ i?24 + 2x G34 + R44\ 
Sv = 



If a horizontal direction correlated value is 
found after averaging signals in the vertical 
direction in a case where the horizontal direction 
correlated value Sh is calculated, and a vertical 
direction correlated value is found after averaging 
signals in the horizontal direction in a case where 
the vertical direction correlated value Sv is 
calculated, as expressed by the following expression 
(14) , the precision is further improved: 
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^ 1^1 2 + 2 X (R22 + 2 X G32 + R42) + G52 _ gl 3 + 2 x (G23 + 2 x ^33 + G43) + B53 \ 
I 10 10 I 

_^ 1 513 + 2 X (G23 + 2 X 533 + G43) + 553 _ G14 + 2x(jg24 + 2xG34 + i?44) + G54 | 

I To ^ I 

Sv = 1^^^ + 2x (i?22 + 2x G23 + R24) + G25 _ 53 1 + 2x (G32 + 2x 533 + G34) + 535 j 
I 10 w i 

1 53 1 + 2 X (G32 + 2 X 533 -f G34) + 535 G4 1 + 2 x (R42 + 2 x G43 + R44) + G45 1 
I 10 m 



••• (14) 

A dividing circuit may be able to be calculated 
by only a bit shift circuit by taking factors by which 
B33, G32, and G34 are respectively multiplexed as 
one in the foregoing expression (14) for calculating 
Sh and taking factors by which B33, G23, and G43 
are respectively multiplexed as one in the 
expression for calculating Sv, to take the divisor 
in each of the expressions as eight which is the n-th 
power of 2. 

The foregoing expression (14) can be 
simplified, as expressed by the following expression 
(14)': 

= I <^12 + 2 X (522 + 2 X G32 + R42) + G52 _ G14 + 2 x (524 + 2 x G34 + 544) + G54 1 
I 10 w I 

Sy^\^^^ + ^>^(^^^ + ^>«^^^ + ^24) + G25 _ G41 + 2 X (542 + 2 x G43 + 544) + G45 1 
I 10 m 
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In a case where the block to be processed is 
chromatic, the correlated values Sh and Sv are 
calculated on the basis of the following expression 
(15): 

^^\ G12 + 2xG32 + G52 G23 + G43 \ \ G23 + G43 G14 + 2xG34 + G 54\ 
i 4 " 2 rl 2 4 I 

^^^,\ G21 + 2xG23 + G25 + G34\ \G32 + G34 G4] + 2xG43 + G45 \ 
I 4 2 rl 2 ' 4 I 

••• (15) 

The foregoing expression (15) can be 
simplified, as expressed by the following expression 
(15)': 

lG12 + 2xG32 + G52 G14 + 2xG34 + G54| 



Sh = l 



Sv. 



4 4 I 

|G21 + 2xG23 + G25 G41 + 2xG43 + G45| 



(15) 



In a case where the block to be processed is 

chromatic, the correlated values Sh and Sv may be 

calculated on the basis of the following expression 

(16) , as in the fifth embodiment: 

5A = |G32-G34| 
5v = |G23-G43| 

Even when the block to be processed is a block 
in an even field, the pattern of the G signal is the 
same, so that the same processing may be performed. 
An operation expression in a case where the block 



to be processed is an odd-numbered block in an odd 
field and an operation expression in a case where 
the block to be processed is an e v e n - n umb e r e d block 
in an even field are the same, and an operation 
expression in a case where the block to be processed 
is an even-numbered block in an odd field and an 
operation expression in a case where the block to 
be processed is an odd-numbered block in an even 
field are the same. 

[B-4-3] Description of modification of a method 
of calculating correlated values Sh and Sv 

Letting Shi and Svl be respectively correlated 
values calculated using operation expressions 
suitable for the case of an achromatic color (e.g., 
the foregoing expression (10)' or (13)'), and 
letting Sh2 and Sv2 calculated using operation 
expressions suitable for the case of a chromatic 
color (e.g., the foregoing expression (12)' or 
(15)'), the correlated values may be weighted and 
added depending on the intensity of the color of a 
block to be processed, to find correlated values Sh 
and S v . 

First, as shown in Fig. 29, the way how an image 
is colored is calculated as a chroma integrated value 
on the basis of the following expression (17) from 
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signals representing all pixels in a chroma 
detection area k including a block to be processed 
out of a plurality of chroma detection areas 
previously set: 

c.=|i;g-£/?|+|x;g-x^| - (17) 

A chromatic c o 1 o r / a c h r o m a t i c color judged 
value Rk corresponding to the chroma integrated 
value calculated by the foregoing expression (17) 
is found from the relationship between a chroma 
integrated value and the chromatic 

color/ achromatic color judged value Rk, as shown in 
Fig. 30. Two threshold values Thl and Th2 in Fig. 
30 are experimentally found because the 
characteristics of an optical LPF (Low-Pass Filter) 
indispensable in s y s t em a t i z a t i o n are also related 
to the threshold values Thl and Th2. 

The correlated values Shi and Svl calculated 
using the operation expression suitable for the case 
of the achromatic color and the correlated values 
Sh2 and Sv2 calculated using the operation 
expression suitable for the case of a chromatic color 
are weighted and added on the basis of the obtained 
chromatic c o 1 o r / a c h r o m a t i c color judged value R]^ , 
as expressed by the following expression: 
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Sh = R^x Shi + {\-R^)y.Sh2 

Sv = R,xSvl + (X-R,)xSv2 "' ^^^^ 

It goes without saying that only the 
expressions (12) and (15) may be used, assuming that 
the block to be processed is always chromatic, 
without making chromatic c o 1 o r / a c h r o m a t i c color 
j udgment . 

[B-5] Description of Eighth Embodiment 
In the primary color correlated color 
separating system used in the primary color 
correlated color separator 24 shown in Fig. 14, when 
the divisor is zero, the result of the calculation 
increases to infinity. In a case where the divisor 
in an operation expression used in the primary color 
correlated color separating system is zero, it is 
preferable that even when the gain of automatic gain 
control means of a camera is small, chrominance 
signals calculated by the color difference 
correlated color separator 25 shown in Fig. 14 are 
used. 

Here, '"a case where the divisor is zero." In 
the primary color correlated color separating 
system, when the divisor is decreased, errors are 
increased. Even when the divisor is not more than 
a predetermined value, the chrominance signals 



calculated by the color difference correlated color 
separator 25 shown in Fig. 14 may be used. 

Specifically, a judgment circuit 40 having LO, 
LI, and L2 as inputs and judging whether or not a 
pixel having a pixel value of zero is included in 
a block to be processed (the block to be processed 
composed of 3 by 3 pixels in the fifth embodiment, 
or the block to be processed composed of 5 by 5 pixels 
in the sixth embodiment) is provided, as shown in 
Fig. 31, in the fifth embodiment. 

The judgment circuit 40 outputs, when it judges 
that the pixel having a pixel value of zero is 
included in the block to be processed, a command to 
output only the chrominance signals calculated by 
the color difference correlated color separator 25 
is outputted to the weighting and addition circuit 
3 6 . 

It is preferable that the same control is also 
carried out in the fifth embodiment. In the adaptive 
correlated color separator 24 in the seventh 
embodiment, the result of the calculation increases 
to infinity when the divisor is zero, as in the 
primary color correlated color separator 24 shown 
in Fig. 14. Therefore, it is preferable that the 
same control is also carried out in the seventh 
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embodiment, . 

Although the present invention has been 
described and illustrated in detail, it is clearly 
understood that the same is by way of illustration 
and example only and is not to be taken by way of 
limitation, the spirit and scope of the present 
invention being limited only by the terms of the 
appended claims. 
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